-- Logs begin at Tue 2021-04-20 17:50:29 UTC, end at Tue 2021-04-20 18:51:14 UTC. -- Apr 20 18:22:20.364729 dv-cinder-786932-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 20 18:22:20.372527 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 20 18:22:20.374669 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: *** Starting uWSGI 2.0.15-debian (64bit) on [Tue Apr 20 18:22:20 2021] *** Apr 20 18:22:20.374669 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 20 18:22:20.374669 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 20 18:22:20.374669 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: nodename: dv-cinder-786932-2-iscsi Apr 20 18:22:20.374669 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: machine: x86_64 Apr 20 18:22:20.374669 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: clock source: unix Apr 20 18:22:20.374669 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: pcre jit disabled Apr 20 18:22:20.374669 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: detected number of CPU cores: 4 Apr 20 18:22:20.374669 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: current working directory: / Apr 20 18:22:20.374669 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: detected binary path: /usr/bin/uwsgi-core Apr 20 18:22:20.374669 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: dropping root privileges as early as possible Apr 20 18:22:20.374669 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: your processes number limit is 47843 Apr 20 18:22:20.374669 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: your memory page size is 4096 bytes Apr 20 18:22:20.374669 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: detected max file descriptor number: 2048 Apr 20 18:22:20.374669 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: lock engine: pthread robust mutexes Apr 20 18:22:20.375895 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: thunder lock: enabled Apr 20 18:22:20.375895 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 20 18:22:20.375895 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: dropping root privileges after socket binding Apr 20 18:22:20.375895 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 20 18:22:20.421986 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: Python main interpreter initialized at 0x56231b5a99c0 Apr 20 18:22:20.421986 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: dropping root privileges after plugin initialization Apr 20 18:22:20.421986 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: python threads support enabled Apr 20 18:22:20.421986 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: your server socket listen backlog is limited to 100 connections Apr 20 18:22:20.421986 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: your mercy for graceful operations on workers is 90 seconds Apr 20 18:22:20.422560 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: mapped 402621 bytes (393 KB) for 2 cores Apr 20 18:22:20.422560 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: *** Operational MODE: preforking *** Apr 20 18:22:20.422735 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: dropping root privileges after application loading Apr 20 18:22:20.422735 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: *** uWSGI is running in multiple interpreter mode *** Apr 20 18:22:20.422735 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: spawned uWSGI master process (pid: 85703) Apr 20 18:22:20.425181 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: spawned uWSGI worker 1 (pid: 85704, cores: 1) Apr 20 18:22:20.425181 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: spawned uWSGI worker 2 (pid: 85705, cores: 1) Apr 20 18:22:20.425181 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 20 18:22:20.422922 dv-cinder-786932-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 20 18:22:25.507955 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 20 18:22:25.508513 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 20 18:22:25.508706 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 20 18:22:25.508811 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 20 18:22:25.510481 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 20 18:22:25.510663 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 20 18:22:25.510912 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 20 18:22:25.511087 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 20 18:22:25.511197 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 20 18:22:25.511380 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 20 18:22:25.511633 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.511838 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.512002 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.512206 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.512362 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.512570 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.512721 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.512931 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.513097 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.513304 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.513448 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.513685 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.513783 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.514046 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.514159 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.514403 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.514511 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.514737 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.514843 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.515043 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.515146 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.515400 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.515500 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786932-2-iscsi {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.515768 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.515868 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786932-2-iscsi {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.516112 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.516211 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.516450 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.516551 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.516798 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.516903 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.517138 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.517246 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.517497 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.517610 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.517848 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.517954 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.518185 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.518462 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.518798 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.518906 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.519134 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.519241 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.519472 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.519578 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.519820 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.519919 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.520170 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.520277 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.520516 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.520616 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.520856 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.520963 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.521196 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.521306 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.521581 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.521691 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.521930 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.522030 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.522272 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.522382 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786932-2-iscsi {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.522621 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.522720 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786932-2-iscsi {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.522970 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.523076 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.523311 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.523429 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.523662 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.523894 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.524110 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.524211 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.524460 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.524673 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.525541 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.525646 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.525914 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.526016 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.526256 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.526365 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.526602 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.526708 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.526975 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.527075 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.527333 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.527442 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.527697 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.527796 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.528039 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.528140 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.528358 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.528476 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.528700 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.528810 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.529050 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.529151 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.529410 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.529524 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.529752 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.529857 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.530039 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.530139 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.530343 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.530444 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.530691 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.530791 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.531056 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.531171 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.531418 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.531520 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.531698 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.531812 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.531985 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.532092 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.532302 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.532402 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.532668 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.532769 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.533013 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.533118 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.533359 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.533493 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.533726 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.533871 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.534074 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.534184 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.534387 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.534500 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.534722 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.534828 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.535057 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.535163 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.535394 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.535501 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.535730 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.535831 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.536085 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.536191 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.536435 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.536542 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.536774 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.536873 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.537122 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.537222 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.537526 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.537644 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.537858 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.537948 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.538207 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.538308 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.538553 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.538720 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.538932 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.539014 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.539281 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.539371 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.539621 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.539708 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.539982 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.540081 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.540389 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.540645 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.540756 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.540854 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.541040 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.541140 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.541414 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.541519 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.541783 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.541890 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.542126 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.542232 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.542410 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.542511 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.542717 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.542824 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.543056 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.543158 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.543402 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.543508 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.543738 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.543858 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.544122 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.544239 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.544404 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.544517 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.544738 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.544844 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.545074 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.545181 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.545437 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.545556 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.545777 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.545884 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.546115 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.546217 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.546451 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.546560 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.546786 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.546891 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.547119 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.547220 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.547451 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.547559 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.547786 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.547885 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.548127 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.548234 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.548480 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.548580 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.548825 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.548924 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.549167 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.549272 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.549528 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.549632 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.549874 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.549974 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.550210 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.550311 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.550552 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.550653 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.550893 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.551006 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.551232 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.551332 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.551566 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.551673 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.551907 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.552012 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.552241 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.552340 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.552584 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.552693 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.552919 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.553018 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.553263 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.553373 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.553619 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.553738 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.553957 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.554090 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.554295 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.554413 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.554625 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.554728 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.554962 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.555062 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.555294 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.555402 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.555625 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.555726 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.555998 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.556114 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.556325 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.556434 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.556665 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.556766 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.557005 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.557111 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.557344 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.557513 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.557704 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.557814 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.558063 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.558181 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.558408 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.558513 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.558747 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.558854 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.559080 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.559180 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.559411 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.559512 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.559772 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:22:25.559879 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.560141 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.560247 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.560506 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.560606 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.560855 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.560955 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.561218 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.561328 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.561611 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.561713 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.561969 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.562079 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.562319 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.562430 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.562665 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.562764 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.563009 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.563115 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.563355 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.563462 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.563697 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.563803 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.564036 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.564142 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.564378 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.564503 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.564735 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.564848 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.565084 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.565185 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.565450 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.565565 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.565808 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.565909 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.566155 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.566267 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.566495 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.566601 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.566834 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.566941 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.567191 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.567294 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.567543 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.567644 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.567892 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.567998 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.568233 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.568335 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.568615 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.568716 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.568959 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.569065 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.569326 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.569507 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.569712 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.569820 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.570054 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.570154 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.570409 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.570511 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.570759 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.570858 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.571103 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.571211 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.571968 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.572080 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.572335 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.572481 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.572690 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.572836 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.573041 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.573219 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.573452 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.573604 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.573814 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.573958 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.574167 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.574300 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.574539 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.574643 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.574830 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.574931 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.575172 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.575272 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.575522 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.575625 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.575863 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.575964 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.576222 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.576322 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.576558 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.577083 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.577362 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.577494 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.577733 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.577841 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.578084 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.578185 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.578427 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.578528 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.578763 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.578864 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.579101 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.579266 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.579440 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.579541 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.579781 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.579893 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.580118 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.580220 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.580471 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.580573 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.580815 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.580924 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.581163 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.581264 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.581525 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.581632 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.581867 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.581980 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.582203 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.582305 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.582540 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.582641 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.582879 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.582988 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.583218 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.583324 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.583564 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.583665 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.583906 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.584015 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.584254 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.584392 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.584604 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.584762 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.584982 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.585085 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.585317 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.585433 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.585706 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.585807 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.586063 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.586166 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.586419 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.586520 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.586760 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.586866 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.587786 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.587901 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.588141 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.588485 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.588586 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.588825 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.588934 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.589171 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.589272 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.589569 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.589685 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.589915 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.590020 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.590255 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.590355 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.590597 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.590698 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.590935 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.591036 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.591298 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.591400 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.591646 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.591754 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.591988 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.592096 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.592327 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.592429 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.592669 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.592771 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.593058 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.593159 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.593438 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.593544 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.593797 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.593899 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.594131 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.594244 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.594490 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.594636 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.594851 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.595065 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.595170 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.595266 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.595511 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.595619 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.595855 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.595963 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.596204 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.596305 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.596556 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.596657 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.596890 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.597002 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.597240 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.597341 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.597609 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.597712 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.597955 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.598067 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.598302 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.598431 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.598662 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.598770 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.599001 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.599112 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.599349 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.599450 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.599711 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.599820 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.600059 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.600166 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.600406 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.600512 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.600753 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.600854 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.601097 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.601198 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.601467 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.601571 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.601812 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.601913 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.602160 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.602268 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.602498 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.602605 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.602978 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.603088 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.603274 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.603377 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.603723 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.603824 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.604074 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.604183 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.604410 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.604511 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.604751 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.604868 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.605100 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.605221 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.605475 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.605580 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.605828 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.605929 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.606192 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.606305 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.606553 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.606660 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.606886 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.606987 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.607229 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.607337 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.607586 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.607687 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.607927 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.608034 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.608278 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.608386 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.608622 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.608727 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.608966 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.609066 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.609319 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.609463 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.609699 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.609878 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.610035 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.610137 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.610394 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.610495 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.610747 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.610854 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.611085 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.611187 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.611439 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.611546 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.611784 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.611885 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.612124 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.612225 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.612471 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.612572 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.612815 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.612916 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.613446 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.613556 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.613802 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.613903 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.614145 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.614245 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.614494 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.614606 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.614843 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.614944 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.615201 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.615315 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.615535 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.615644 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.615884 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.615985 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.616230 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.616331 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.616566 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.616679 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.616916 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.617017 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.617264 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.617372 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.617646 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.618008 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.618110 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.618418 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.618856 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.619225 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.619348 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.619582 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.619692 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.619943 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.620045 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.620311 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.620422 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.620676 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.620777 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.621030 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.621131 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.621376 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.621578 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.621750 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.621851 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.622098 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.622199 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.622440 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.622548 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.622786 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.622886 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.623144 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.623250 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.623491 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.623642 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.623824 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.623925 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.624170 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.624270 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.624512 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.624613 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.624846 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.624933 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.625261 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.625382 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.625556 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.625659 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.625904 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.626006 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.626244 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.626344 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.626587 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.626688 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.626930 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.627037 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.627269 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.627370 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.627614 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.627719 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.627953 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.628055 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.628292 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.628459 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.628634 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.628764 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.628974 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.629076 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.629323 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.629455 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.629699 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.629807 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.630096 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.630204 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.630446 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.630554 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.630799 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.630906 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.631139 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.631240 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.631509 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.631626 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.631854 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.631954 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.632194 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.632294 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.632535 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.632635 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.632882 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.632982 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.633222 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.633322 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.633605 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.633714 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.634487 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.634602 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.634832 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.635175 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.635313 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.635522 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.635636 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.635863 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.635964 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.636221 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.636339 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.636566 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.636669 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.636911 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.637013 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.637252 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.637361 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.637628 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.637738 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.637972 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.638124 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.638314 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.638422 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.638657 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.638781 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.639010 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.639121 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.639349 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.639458 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.639690 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.639792 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.640024 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.640125 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.640368 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.640470 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.640713 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.640821 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.641059 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.641167 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.641424 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.641530 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.641772 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.641873 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.642118 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.642219 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.642454 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.642557 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.642802 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.642957 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.643141 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.643256 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.643486 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.643595 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.643816 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.643929 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.644147 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.644267 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.644485 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.644588 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.644819 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.644927 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.645157 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.645322 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.645618 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.645736 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.645851 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.645949 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.646183 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.646294 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.646520 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.646627 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.646866 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.646980 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.647222 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.647356 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.647570 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.647674 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.647924 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.648033 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.648282 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.648438 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.648636 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.648798 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.648997 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.649132 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.649349 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.650298 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.650471 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.650616 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.650774 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.650994 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.651345 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.651455 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.651689 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.651790 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.652033 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.652141 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.652400 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.652510 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.652746 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.652854 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.653107 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.653231 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.653485 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.653591 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.653832 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.653934 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.654186 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.654296 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.654518 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.654626 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.654869 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.654975 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.655219 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.655314 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.655559 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.655825 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.655937 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.656035 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.656227 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.656337 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.656576 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.656676 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.656933 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.657060 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.657272 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.657382 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.657646 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.657747 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.658038 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.658145 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.658339 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.658452 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.658679 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.658796 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.659026 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.659158 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.659360 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.659463 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.659711 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.659812 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.660051 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.660159 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.660394 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.660503 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.660740 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.660846 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.661076 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.661187 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.661484 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.661602 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.661789 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.661897 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.662139 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.662308 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.662489 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.662591 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.662848 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.662964 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.663206 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.663344 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.663553 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.663662 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.663901 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.664002 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.664249 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.664404 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.664601 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.664762 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.664946 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.665093 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.665508 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.665983 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.666099 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.666345 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.666446 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.666691 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.666824 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.667039 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.667141 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.667385 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.667485 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.667726 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.667835 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.668089 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.668189 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.668434 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.668534 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.668777 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.668886 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.669120 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.669252 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.669508 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.669617 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.669858 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.669976 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.670224 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.670324 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.670586 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.670686 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.670936 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.671045 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.671286 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.671387 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.671634 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.671777 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.672005 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.672109 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.672356 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.672456 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.672726 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.672826 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.673122 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.673230 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.673513 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.673617 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.673858 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.673958 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.674210 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.674318 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.674559 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.674660 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.674959 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.675059 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.675328 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.675430 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.675681 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.675782 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.676037 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.676146 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.676380 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.676488 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.676739 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.676841 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.677086 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.677198 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.677461 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.677593 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.677826 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.677925 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.678201 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.678312 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.678563 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.678659 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.678912 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.679006 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.679286 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.679384 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.679652 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.679792 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.679995 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.680098 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.680340 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.680454 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.680689 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.681331 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.681652 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.682093 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.682245 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.682466 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.682611 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.682814 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.682988 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.683168 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.683367 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.683521 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.683723 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.683872 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.684075 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.684216 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.684431 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.684532 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.684784 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.684884 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.685134 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.685235 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.685533 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.685639 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.685885 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.686015 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.686243 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.686358 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.686597 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.686700 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.686932 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.687034 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.687272 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.687390 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.687619 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.687720 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.687965 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.688065 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.688305 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.688413 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.688649 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.688750 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.689008 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.689108 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.689354 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.689498 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.689743 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.689848 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.690085 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.690187 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.690457 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.690566 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.690798 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.690900 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.691178 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.691286 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.691545 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.691647 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.691901 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.692008 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.692262 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.692362 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.692627 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.692729 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.692971 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.693072 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.693312 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.693442 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.693688 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.693789 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.694032 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.694133 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.694376 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.694477 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.694717 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.694819 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.695063 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.695164 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.695405 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.695517 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.695745 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.695897 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.696086 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.696194 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.696695 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.696814 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.696814 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.697268 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.697373 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.697669 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.697772 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.698018 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.698134 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.698360 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.698463 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.698703 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.698812 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.699043 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.699156 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.699392 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.699546 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.699740 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.699849 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.700097 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.700206 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.700433 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.700541 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.700803 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.700905 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.701142 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.701252 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.701526 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.701682 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.701877 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.701979 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.702226 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.702328 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.702580 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.702683 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.702931 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.703032 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.703278 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.703386 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.703631 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.703733 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.703986 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.704095 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.704333 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.704435 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.704677 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.704779 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.705024 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.705136 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.705379 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.705509 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.705757 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.706044 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.706146 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.706418 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.706523 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.706771 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.706878 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.707122 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.707229 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.707464 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.707567 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.707811 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.707912 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.708154 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.708255 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.708507 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.708609 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.708847 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.708948 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.709194 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.709505 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.709625 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.709881 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.710040 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.710239 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.710347 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.710593 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.710696 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.710947 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.711049 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.711301 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.711403 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.711649 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.711759 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.711994 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.712649 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.712912 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.713368 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.713509 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.713753 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.713857 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.714101 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.714203 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.714466 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.714568 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.714827 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.714929 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.715187 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.715296 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.715547 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.715649 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.715905 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.716039 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.716252 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.716386 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.716604 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.716707 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.716953 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.717057 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.717300 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.717445 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.717678 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.717780 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.718034 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.718136 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.718394 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.718498 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.718761 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.718868 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.719112 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.719213 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.719464 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.719566 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.719817 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.719921 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.720165 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.720267 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.720533 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.720740 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.720894 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.721093 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.721249 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.721492 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.721654 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.721867 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.722014 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.722229 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.722368 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.722583 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.722761 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.722937 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.723125 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.723307 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.723482 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.723651 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.723850 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.724025 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.724214 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.724317 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.724634 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.724806 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.724975 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.725165 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.725341 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.725573 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.725687 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.725947 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.726049 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.726321 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.726422 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.726678 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.726797 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.727032 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.727285 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.727387 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.727784 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.728007 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.728126 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.728432 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.728580 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.728802 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.728943 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.729158 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.729288 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.729528 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.729635 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.729895 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.729998 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.730240 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.730346 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.730583 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.730684 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.730938 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.731039 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.731288 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.731391 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.731632 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.731900 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.732002 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.732295 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.732408 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.732641 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.732749 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.732982 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.733083 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.733332 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.733479 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.733704 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.733805 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.734051 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.734154 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.734391 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.734499 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.734733 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.734834 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.735076 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.735159 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.735420 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.735522 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.735762 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.735864 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.736102 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.736222 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.736435 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.736544 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.736775 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.736876 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.737117 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.737218 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.737471 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.737577 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.737818 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.737927 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.738418 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.738526 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.738760 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.738864 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.739102 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.739205 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.739442 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.739543 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.739775 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.739907 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.740123 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.740250 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.740457 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.740566 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.740796 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.740909 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.741143 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.741251 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.741514 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.741635 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.741865 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.741973 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.742206 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.742307 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.742551 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.742660 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.742899 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.743001 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.743258 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.743898 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.744634 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.744760 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.744993 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.745096 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.745348 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.745504 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.745751 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.745855 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.746104 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.746206 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.746449 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.746550 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.746796 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.746898 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.747141 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.747249 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.747497 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.747601 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.747846 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.747950 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.748187 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.748288 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.748537 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.748639 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.748884 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.748987 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.749239 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.749550 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.749658 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.749937 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.750087 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.750283 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.750428 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.750631 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.750734 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.750978 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.751081 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.751364 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.751465 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.751707 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.751809 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.752058 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.752167 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.752412 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.752514 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.752770 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.752873 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.753120 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.753223 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.753492 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.753597 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.753842 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.753956 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.754190 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.754291 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.754538 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.754640 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.754893 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.755002 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.755239 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.755340 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.755582 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.755685 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.755935 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.756045 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.756329 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.756430 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.756696 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.756833 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.757055 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.757164 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.757414 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.757518 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.757786 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.757888 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.758144 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.758246 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.758501 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.758608 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.758854 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.759042 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.759776 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.760117 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.760270 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.760464 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.760631 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.760815 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.761022 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.761211 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.761434 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.761626 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.761739 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.761991 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.762234 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.762336 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.762600 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.762807 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.762967 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.763170 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.763335 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.763522 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.763693 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.763876 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.764073 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.764231 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.764473 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.764574 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.764853 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.764956 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.765244 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.765354 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.765620 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.765723 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.765965 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.766076 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.766308 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.766419 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.766662 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.766764 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.767060 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.767284 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.767450 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.767816 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.767924 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.768186 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.768456 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.768558 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.768900 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.769062 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.769256 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.769659 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.769764 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.770017 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.770341 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.770444 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.770711 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.770937 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.771080 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.771321 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.771430 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.771685 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.771788 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.772117 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.772278 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.772475 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.772840 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.772941 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.773188 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.773532 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.773649 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.773921 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.774031 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.774285 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.774387 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.774686 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.774804 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.775114 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.775633 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.775760 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.776050 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.776169 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.776422 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.776651 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.776802 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.777124 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.777227 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.777544 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.777729 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.777920 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.778286 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.778388 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.778642 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.778744 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.779027 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.779181 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.779384 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.779486 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.779742 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.779844 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.780102 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.780205 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.780451 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.780560 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.780806 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.780908 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.781155 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.781258 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.781560 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.781666 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.781920 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.782033 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.782265 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.782373 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.782612 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.782713 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.782975 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.783085 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.783333 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.783435 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.783684 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.783793 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.784034 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.784144 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.784407 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.784509 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.784760 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.784871 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.785122 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.785225 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.785520 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.785628 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.785875 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.785977 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.786234 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.786338 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.786596 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.786699 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.786869 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85705) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 20 18:22:25.787022 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.787320 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.787696 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.788071 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.788474 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.788837 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.789234 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.789674 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:22:25.789960 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=85704) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 20 18:22:25.826639 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_db.sqlalchemy.engines [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85705) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:22:25.828838 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_db.sqlalchemy.engines [None req-a63b86de-6685-4398-bb3a-7548686c25fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85704) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:22:26.176710 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.context [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d5aad75-0cd5-4608-84e6-b1adec1c0420(cell1) {{(pid=85705) load_cells /opt/stack/nova/nova/context.py:466}} Apr 20 18:22:26.182497 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85705) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:26.184476 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=85705) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:26.185353 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85705) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:26.187510 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=85705) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:26.191012 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.context [None req-a63b86de-6685-4398-bb3a-7548686c25fe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d5aad75-0cd5-4608-84e6-b1adec1c0420(cell1) {{(pid=85704) load_cells /opt/stack/nova/nova/context.py:466}} Apr 20 18:22:26.197125 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-a63b86de-6685-4398-bb3a-7548686c25fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:26.199797 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-a63b86de-6685-4398-bb3a-7548686c25fe None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=85704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:26.200722 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-a63b86de-6685-4398-bb3a-7548686c25fe None None] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:22:26.202922 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-a63b86de-6685-4398-bb3a-7548686c25fe None None] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=85704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:22:26.211914 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_db.sqlalchemy.engines [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85705) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:22:26.218404 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_db.sqlalchemy.engines [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85705) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:22:26.233082 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_db.sqlalchemy.engines [None req-a63b86de-6685-4398-bb3a-7548686c25fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85704) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:22:26.234024 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_db.sqlalchemy.engines [None req-a63b86de-6685-4398-bb3a-7548686c25fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85704) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:22:26.248518 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_db.sqlalchemy.engines [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85705) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:22:26.268788 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_db.sqlalchemy.engines [None req-a63b86de-6685-4398-bb3a-7548686c25fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=85704) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:22:26.347557 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 18:22:26.347557 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: from cryptography.utils import int_from_bytes Apr 20 18:22:26.347939 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 18:22:26.347939 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: from cryptography.utils import int_from_bytes Apr 20 18:22:26.351468 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 18:22:26.351468 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: from cryptography.utils import int_from_bytes Apr 20 18:22:26.353786 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 18:22:26.353786 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: from cryptography.utils import int_from_bytes Apr 20 18:22:26.425856 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO keyring.backend [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] Loading Gnome Apr 20 18:22:26.429326 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO keyring.backend [None req-a63b86de-6685-4398-bb3a-7548686c25fe None None] Loading Gnome Apr 20 18:22:26.448060 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO keyring.backend [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] Loading Google Apr 20 18:22:26.451307 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO keyring.backend [None req-a63b86de-6685-4398-bb3a-7548686c25fe None None] Loading Google Apr 20 18:22:26.451446 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO keyring.backend [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] Loading Windows (alt) Apr 20 18:22:26.454740 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO keyring.backend [None req-a63b86de-6685-4398-bb3a-7548686c25fe None None] Loading Windows (alt) Apr 20 18:22:26.456183 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO keyring.backend [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] Loading file Apr 20 18:22:26.457284 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO keyring.backend [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] Loading keyczar Apr 20 18:22:26.457758 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO keyring.backend [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] Loading multi Apr 20 18:22:26.458651 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO keyring.backend [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] Loading pyfs Apr 20 18:22:26.459390 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO keyring.backend [None req-a63b86de-6685-4398-bb3a-7548686c25fe None None] Loading file Apr 20 18:22:26.460672 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO keyring.backend [None req-a63b86de-6685-4398-bb3a-7548686c25fe None None] Loading keyczar Apr 20 18:22:26.461125 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO keyring.backend [None req-a63b86de-6685-4398-bb3a-7548686c25fe None None] Loading multi Apr 20 18:22:26.462030 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO keyring.backend [None req-a63b86de-6685-4398-bb3a-7548686c25fe None None] Loading pyfs Apr 20 18:22:26.745492 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: WARNING keystonemiddleware.auth_token [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 18:22:26.752645 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: WARNING keystonemiddleware.auth_token [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 18:22:26.763805 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: WARNING keystonemiddleware.auth_token [None req-a63b86de-6685-4398-bb3a-7548686c25fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 18:22:26.770929 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: WARNING keystonemiddleware.auth_token [None req-a63b86de-6685-4398-bb3a-7548686c25fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 18:22:27.092894 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: WARNING keystonemiddleware.auth_token [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 18:22:27.098574 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: WARNING keystonemiddleware.auth_token [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 18:22:27.105664 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56231b5a99c0 pid: 85705 (default app) Apr 20 18:22:27.107925 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:22:27.109119 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001839 Apr 20 18:22:27.109589 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 779 bytes} [Tue Apr 20 18:22:27 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:22:27.113792 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: WARNING keystonemiddleware.auth_token [None req-a63b86de-6685-4398-bb3a-7548686c25fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 18:22:27.121475 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: WARNING keystonemiddleware.auth_token [None req-a63b86de-6685-4398-bb3a-7548686c25fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 18:22:27.128123 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56231b5a99c0 pid: 85704 (default app) Apr 20 18:23:58.957968 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:58.959048 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001610 Apr 20 18:23:58.959469 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 920 bytes} [Tue Apr 20 18:23:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:23:59.480239 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-cff69760-e35c-47ad-9486-34cb7ec6c2b2 admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:23:59.511588 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-cff69760-e35c-47ad-9486-34cb7ec6c2b2 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.543409 Apr 20 18:23:59.512514 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1281 bytes} [Tue Apr 20 18:23:58 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:02.235342 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:02.236561 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-306ad3cb-7253-413f-ad54-819ab93d63cf None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001630 Apr 20 18:24:02.237205 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 920 bytes} [Tue Apr 20 18:24:02 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:24:02.304772 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-e8b76856-8730-4b38-ba02-3729b9841df7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "c1", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1, "name": "cirros256", "os-flavor-access:is_public": true}} {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:02.329159 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:24:02.329159 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: warnings.warn(msg) Apr 20 18:24:02.357317 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-e8b76856-8730-4b38-ba02-3729b9841df7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.112317 Apr 20 18:24:02.358126 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1272 bytes} [Tue Apr 20 18:24:02 2021] POST /compute/v2.1/flavors => generated 407 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:02.626787 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-4204e9d4-e05e-400a-b4c2-63599482311e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:02.630247 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:24:02.630247 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: warnings.warn(msg) Apr 20 18:24:02.677727 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-4204e9d4-e05e-400a-b4c2-63599482311e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.309061 Apr 20 18:24:02.678469 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1325 bytes} [Tue Apr 20 18:24:02 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:05.301367 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-e8b76856-8730-4b38-ba02-3729b9841df7 admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:05.302483 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-e8b76856-8730-4b38-ba02-3729b9841df7 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Apr 20 18:24:05.303046 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 920 bytes} [Tue Apr 20 18:24:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:24:05.433191 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-b868affb-a78a-497c-a2cb-66daf475a8e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "id": "d1", "rxtx_factor": 1.0}} {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:05.457236 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:24:05.457236 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: warnings.warn(msg) Apr 20 18:24:05.484687 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-b868affb-a78a-497c-a2cb-66daf475a8e3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.174042 Apr 20 18:24:05.485349 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1272 bytes} [Tue Apr 20 18:24:05 2021] POST /compute/v2.1/flavors => generated 404 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:05.499116 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-2ba87174-3874-4400-87eb-43fb309e7dea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:05.500742 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:24:05.500742 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: warnings.warn(msg) Apr 20 18:24:05.539043 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-2ba87174-3874-4400-87eb-43fb309e7dea admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043025 Apr 20 18:24:05.539475 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1325 bytes} [Tue Apr 20 18:24:05 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:08.219112 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-b868affb-a78a-497c-a2cb-66daf475a8e3 admin admin] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:08.220197 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-b868affb-a78a-497c-a2cb-66daf475a8e3 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Apr 20 18:24:08.220619 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 920 bytes} [Tue Apr 20 18:24:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:24:08.299831 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-d42dd3cd-9e19-4b13-a566-8b53fd09fb0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds1G", "ram": 1024}} {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:08.327455 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-d42dd3cd-9e19-4b13-a566-8b53fd09fb0a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.099318 Apr 20 18:24:08.328249 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1272 bytes} [Tue Apr 20 18:24:08 2021] POST /compute/v2.1/flavors => generated 404 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:08.342602 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-b06b01d4-4039-40ca-8117-6486d2381d30 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:08.385071 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-b06b01d4-4039-40ca-8117-6486d2381d30 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046308 Apr 20 18:24:08.386521 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1325 bytes} [Tue Apr 20 18:24:08 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:11.021641 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-d42dd3cd-9e19-4b13-a566-8b53fd09fb0a admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:11.023272 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-d42dd3cd-9e19-4b13-a566-8b53fd09fb0a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002152 Apr 20 18:24:11.023995 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 920 bytes} [Tue Apr 20 18:24:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:24:11.094242 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-54d02a17-16b2-460e-aaac-b200fe3a893e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G"}} {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:11.119662 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-54d02a17-16b2-460e-aaac-b200fe3a893e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.088543 Apr 20 18:24:11.120369 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1272 bytes} [Tue Apr 20 18:24:11 2021] POST /compute/v2.1/flavors => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:11.134282 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-2cf1befd-3e18-46ce-916f-886db0c75193 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:11.174920 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-2cf1befd-3e18-46ce-916f-886db0c75193 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045003 Apr 20 18:24:11.182858 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1325 bytes} [Tue Apr 20 18:24:11 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:13.780787 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-54d02a17-16b2-460e-aaac-b200fe3a893e admin admin] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:13.781974 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-54d02a17-16b2-460e-aaac-b200fe3a893e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001692 Apr 20 18:24:13.782441 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 920 bytes} [Tue Apr 20 18:24:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:24:13.853275 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-9ffb31b9-de85-45eb-bb38-efc10eaf588d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 4, "disk": 20, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0}} {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:13.879465 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-9ffb31b9-de85-45eb-bb38-efc10eaf588d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087606 Apr 20 18:24:13.880226 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1272 bytes} [Tue Apr 20 18:24:13 2021] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:13.894179 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-d705ef45-a40a-4b50-9600-34a5176cc6cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:13.933887 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-d705ef45-a40a-4b50-9600-34a5176cc6cb admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043562 Apr 20 18:24:13.935162 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1325 bytes} [Tue Apr 20 18:24:13 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:16.608453 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-9ffb31b9-de85-45eb-bb38-efc10eaf588d admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:16.609563 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-9ffb31b9-de85-45eb-bb38-efc10eaf588d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Apr 20 18:24:16.610013 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 920 bytes} [Tue Apr 20 18:24:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:24:16.713039 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-17b495d5-6986-4b4f-a83e-2ada47f6a156 admin admin] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:16.739697 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-17b495d5-6986-4b4f-a83e-2ada47f6a156 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.122148 Apr 20 18:24:16.740292 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1281 bytes} [Tue Apr 20 18:24:16 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:24:19.324226 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-9ffb31b9-de85-45eb-bb38-efc10eaf588d admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:19.325868 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-9ffb31b9-de85-45eb-bb38-efc10eaf588d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002262 Apr 20 18:24:19.326493 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 920 bytes} [Tue Apr 20 18:24:19 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:24:19.412885 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-f3b35192-7708-4286-9ccc-ef5fbcfd3b24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "1", "disk": 1, "ram": 512}} {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:19.439362 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-f3b35192-7708-4286-9ccc-ef5fbcfd3b24 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.104527 Apr 20 18:24:19.439973 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1272 bytes} [Tue Apr 20 18:24:19 2021] POST /compute/v2.1/flavors => generated 402 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:19.456357 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-58ca76de-5977-4256-b907-27ba66a7d4d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:19.511943 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-58ca76de-5977-4256-b907-27ba66a7d4d1 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.061213 Apr 20 18:24:19.512788 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1322 bytes} [Tue Apr 20 18:24:19 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:22.591989 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-f3b35192-7708-4286-9ccc-ef5fbcfd3b24 admin admin] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:22.593068 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-f3b35192-7708-4286-9ccc-ef5fbcfd3b24 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Apr 20 18:24:22.593674 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 920 bytes} [Tue Apr 20 18:24:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:24:22.657795 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-5a69def6-ccda-4399-a5a5-8f09fc1c7a71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "name": "m1.small", "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:22.684095 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-5a69def6-ccda-4399-a5a5-8f09fc1c7a71 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082908 Apr 20 18:24:22.684630 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1272 bytes} [Tue Apr 20 18:24:22 2021] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:24:22.697480 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-a35797d7-4059-4e8c-94f0-aae9d4b2529f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:22.734596 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-a35797d7-4059-4e8c-94f0-aae9d4b2529f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041191 Apr 20 18:24:22.735223 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1322 bytes} [Tue Apr 20 18:24:22 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:25.313144 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-5a69def6-ccda-4399-a5a5-8f09fc1c7a71 admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:25.314265 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-5a69def6-ccda-4399-a5a5-8f09fc1c7a71 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Apr 20 18:24:25.314724 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 920 bytes} [Tue Apr 20 18:24:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:24:25.388182 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-fd689177-0c20-4354-81f9-30c7d1f26a21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "disk": 40, "id": "3", "name": "m1.medium"}} {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:25.414719 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-fd689177-0c20-4354-81f9-30c7d1f26a21 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.092239 Apr 20 18:24:25.415334 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1272 bytes} [Tue Apr 20 18:24:25 2021] POST /compute/v2.1/flavors => generated 406 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:25.428872 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-aca03579-ad3e-4f0b-ad14-1055b3ec2e7a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:25.479756 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-aca03579-ad3e-4f0b-ad14-1055b3ec2e7a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055516 Apr 20 18:24:25.480795 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1322 bytes} [Tue Apr 20 18:24:25 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:28.092959 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-fd689177-0c20-4354-81f9-30c7d1f26a21 admin admin] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:28.094225 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-fd689177-0c20-4354-81f9-30c7d1f26a21 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001843 Apr 20 18:24:28.094877 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 920 bytes} [Tue Apr 20 18:24:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:24:28.165726 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-8f623cf0-4c28-4499-b82e-4c7970a751d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "4", "name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true, "disk": 80, "rxtx_factor": 1.0}} {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:28.196633 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-8f623cf0-4c28-4499-b82e-4c7970a751d7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.093717 Apr 20 18:24:28.197351 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1272 bytes} [Tue Apr 20 18:24:28 2021] POST /compute/v2.1/flavors => generated 405 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:28.211660 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-acd3a1bc-4d64-417f-baed-1bb127bd18e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:28.254735 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-acd3a1bc-4d64-417f-baed-1bb127bd18e0 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047823 Apr 20 18:24:28.265493 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1322 bytes} [Tue Apr 20 18:24:28 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:24:30.828277 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-8f623cf0-4c28-4499-b82e-4c7970a751d7 admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:24:30.829342 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-8f623cf0-4c28-4499-b82e-4c7970a751d7 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Apr 20 18:24:30.830018 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 920 bytes} [Tue Apr 20 18:24:30 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:24:30.902359 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-c21162c4-8e15-4c0a-8806-c945ac2b3ce6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384, "swap": 0}} {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:30.931415 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-c21162c4-8e15-4c0a-8806-c945ac2b3ce6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.093573 Apr 20 18:24:30.932118 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1272 bytes} [Tue Apr 20 18:24:30 2021] POST /compute/v2.1/flavors => generated 408 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:24:30.946903 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-09b7364e-c361-496c-b417-3407eb3b0c5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:24:30.989731 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-09b7364e-c361-496c-b417-3407eb3b0c5b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048054 Apr 20 18:24:30.991625 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1322 bytes} [Tue Apr 20 18:24:30 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:25:11.936242 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-c21162c4-8e15-4c0a-8806-c945ac2b3ce6 admin admin] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:11.937376 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-c21162c4-8e15-4c0a-8806-c945ac2b3ce6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Apr 20 18:25:11.937862 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 920 bytes} [Tue Apr 20 18:25:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:25:11.998995 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-f1ebb6e0-4e24-4849-9142-acb1e1289211 admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:12.025227 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-f1ebb6e0-4e24-4849-9142-acb1e1289211 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.079843 Apr 20 18:25:12.025942 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1281 bytes} [Tue Apr 20 18:25:11 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:13.720078 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-c21162c4-8e15-4c0a-8806-c945ac2b3ce6 admin admin] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:13.721150 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-c21162c4-8e15-4c0a-8806-c945ac2b3ce6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Apr 20 18:25:13.721614 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1065 bytes} [Tue Apr 20 18:25:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:25:13.905550 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-128de2c8-8fc0-46a8-9f0d-4da7fd951370 admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:13.920342 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.wsgi [None req-128de2c8-8fc0-46a8-9f0d-4da7fd951370 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 20 18:25:13.920972 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-128de2c8-8fc0-46a8-9f0d-4da7fd951370 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=85704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:25:13.921912 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-128de2c8-8fc0-46a8-9f0d-4da7fd951370 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.071682 Apr 20 18:25:13.922424 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1181 bytes} [Tue Apr 20 18:25:13 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 18:25:13.933263 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-1c1efc84-9039-4efc-903c-8ba042c6ca8d admin admin] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:13.955009 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-1c1efc84-9039-4efc-903c-8ba042c6ca8d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025755 Apr 20 18:25:13.955616 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1201 bytes} [Tue Apr 20 18:25:13 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:13.966148 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-1bdad8fe-d55b-4eb4-b613-49c18c5909c0 admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:13.988718 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-1bdad8fe-d55b-4eb4-b613-49c18c5909c0 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026377 Apr 20 18:25:13.989583 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1201 bytes} [Tue Apr 20 18:25:13 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:13.999766 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-e07bd554-7725-46d8-80b6-d0ed911f0aad admin admin] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:14.014703 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.wsgi [None req-e07bd554-7725-46d8-80b6-d0ed911f0aad admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 20 18:25:14.015331 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-e07bd554-7725-46d8-80b6-d0ed911f0aad admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=85705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:25:14.016179 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-e07bd554-7725-46d8-80b6-d0ed911f0aad admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.020376 Apr 20 18:25:14.016735 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1181 bytes} [Tue Apr 20 18:25:13 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 18:25:15.611176 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-1bdad8fe-d55b-4eb4-b613-49c18c5909c0 admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:15.612524 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-1bdad8fe-d55b-4eb4-b613-49c18c5909c0 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001864 Apr 20 18:25:15.612964 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1065 bytes} [Tue Apr 20 18:25:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:25:15.797855 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-f0e01e41-15ce-4c38-a9c3-b920917f28d6 admin admin] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:15.811543 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.wsgi [None req-f0e01e41-15ce-4c38-a9c3-b920917f28d6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 20 18:25:15.812166 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-f0e01e41-15ce-4c38-a9c3-b920917f28d6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=85705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:25:15.813024 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-f0e01e41-15ce-4c38-a9c3-b920917f28d6 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.071371 Apr 20 18:25:15.813653 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1181 bytes} [Tue Apr 20 18:25:15 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 18:25:15.824149 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-812655fb-a641-42e5-a36f-c0d6c51c1cc1 admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:15.848203 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-812655fb-a641-42e5-a36f-c0d6c51c1cc1 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.027639 Apr 20 18:25:15.848815 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1201 bytes} [Tue Apr 20 18:25:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:15.859414 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-bd37d768-2d60-431b-8274-968fbb624b1b admin admin] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:15.882740 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-bd37d768-2d60-431b-8274-968fbb624b1b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.027132 Apr 20 18:25:15.883332 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1201 bytes} [Tue Apr 20 18:25:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:15.893499 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-ec2a5b6a-87c4-4b5f-8057-252094b907b4 admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:15.906843 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.wsgi [None req-ec2a5b6a-87c4-4b5f-8057-252094b907b4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 20 18:25:15.907453 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-ec2a5b6a-87c4-4b5f-8057-252094b907b4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=85704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:25:15.908284 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-ec2a5b6a-87c4-4b5f-8057-252094b907b4 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.018733 Apr 20 18:25:15.908836 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1181 bytes} [Tue Apr 20 18:25:15 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 18:25:17.508939 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-bd37d768-2d60-431b-8274-968fbb624b1b admin admin] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:17.510096 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-bd37d768-2d60-431b-8274-968fbb624b1b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Apr 20 18:25:17.510537 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1065 bytes} [Tue Apr 20 18:25:17 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:25:17.696351 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-362df44e-a02a-4792-8ab8-b63eede04567 admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:17.710051 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.wsgi [None req-362df44e-a02a-4792-8ab8-b63eede04567 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 20 18:25:17.710672 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-362df44e-a02a-4792-8ab8-b63eede04567 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=85704) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:25:17.711528 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-362df44e-a02a-4792-8ab8-b63eede04567 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.071481 Apr 20 18:25:17.712099 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1184 bytes} [Tue Apr 20 18:25:17 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 18:25:17.722443 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-536dba17-8145-45e6-9b72-b6d6e702a2a6 admin admin] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:17.744761 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-536dba17-8145-45e6-9b72-b6d6e702a2a6 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026135 Apr 20 18:25:17.745373 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1201 bytes} [Tue Apr 20 18:25:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:17.756658 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-f570a8af-758a-4786-b5a8-226598b37496 admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:17.778701 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-f570a8af-758a-4786-b5a8-226598b37496 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026628 Apr 20 18:25:17.779289 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1201 bytes} [Tue Apr 20 18:25:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:25:17.789744 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-a4f7117d-2886-48c0-8ec6-2584ce6f5c00 admin admin] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:17.803262 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.wsgi [None req-a4f7117d-2886-48c0-8ec6-2584ce6f5c00 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 20 18:25:17.803910 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-a4f7117d-2886-48c0-8ec6-2584ce6f5c00 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=85705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:25:17.804732 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-a4f7117d-2886-48c0-8ec6-2584ce6f5c00 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.019235 Apr 20 18:25:17.805302 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1184 bytes} [Tue Apr 20 18:25:17 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 20 18:25:19.383081 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-f570a8af-758a-4786-b5a8-226598b37496 admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:19.384145 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-f570a8af-758a-4786-b5a8-226598b37496 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Apr 20 18:25:19.384690 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1065 bytes} [Tue Apr 20 18:25:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:25:19.569727 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-dfdca074-21fd-498e-8861-537a90cda287 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:25:19.594876 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-dfdca074-21fd-498e-8861-537a90cda287 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.080706 Apr 20 18:25:19.595409 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1226 bytes} [Tue Apr 20 18:25:19 2021] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:25:21.215696 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-f570a8af-758a-4786-b5a8-226598b37496 admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:21.216819 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-f570a8af-758a-4786-b5a8-226598b37496 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Apr 20 18:25:21.217268 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1065 bytes} [Tue Apr 20 18:25:21 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:25:21.405723 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-f2544dbe-f1da-4f9f-8113-78bbf9efa6b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:25:21.430771 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-f2544dbe-f1da-4f9f-8113-78bbf9efa6b7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.086276 Apr 20 18:25:21.431386 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1226 bytes} [Tue Apr 20 18:25:21 2021] POST /compute/v2.1/flavors => generated 405 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:25:23.033860 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-f570a8af-758a-4786-b5a8-226598b37496 admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:23.034979 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-f570a8af-758a-4786-b5a8-226598b37496 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Apr 20 18:25:23.035415 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1065 bytes} [Tue Apr 20 18:25:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:25:23.218500 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-63aad7c9-9c07-45b7-abcb-5e13a4b5415c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:25:23.243982 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-63aad7c9-9c07-45b7-abcb-5e13a4b5415c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.079454 Apr 20 18:25:23.244511 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1226 bytes} [Tue Apr 20 18:25:23 2021] POST /compute/v2.1/flavors => generated 407 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:25:24.841434 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-f570a8af-758a-4786-b5a8-226598b37496 admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:24.842547 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-f570a8af-758a-4786-b5a8-226598b37496 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Apr 20 18:25:24.842974 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1065 bytes} [Tue Apr 20 18:25:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:25:25.028386 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-a2fec6b1-a9bd-4014-a8e2-35ae7f882765 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:25:25.057211 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-a2fec6b1-a9bd-4014-a8e2-35ae7f882765 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.085562 Apr 20 18:25:25.057856 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1226 bytes} [Tue Apr 20 18:25:24 2021] POST /compute/v2.1/flavors => generated 409 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:25:26.640777 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-f570a8af-758a-4786-b5a8-226598b37496 admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:26.641869 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-f570a8af-758a-4786-b5a8-226598b37496 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Apr 20 18:25:26.642315 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1065 bytes} [Tue Apr 20 18:25:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:25:26.827436 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-df00512a-06c0-4375-977e-9816c863a4ff admin admin] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:25:26.858088 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-df00512a-06c0-4375-977e-9816c863a4ff admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.087692 Apr 20 18:25:26.858716 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Apr 20 18:25:26 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:26:19.048328 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-f570a8af-758a-4786-b5a8-226598b37496 admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:19.049406 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-f570a8af-758a-4786-b5a8-226598b37496 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Apr 20 18:26:19.050075 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 31/63] 10.222.0.25 () {56 vars in 1065 bytes} [Tue Apr 20 18:26:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:26:19.241041 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-4cfbe7d0-6fb5-447b-8b30-9db6b481c56c admin admin] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:26:19.269441 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-4cfbe7d0-6fb5-447b-8b30-9db6b481c56c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.083416 Apr 20 18:26:19.270024 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Apr 20 18:26:19 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:27:47.293291 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-623bc27c-8ff3-4366-8580-6ab5a0072b6b tempest-verify_tempest_config-731513907 tempest-verify_tempest_config-731513907-project] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:27:47.295414 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-623bc27c-8ff3-4366-8580-6ab5a0072b6b tempest-verify_tempest_config-731513907 tempest-verify_tempest_config-731513907-project] 10.222.0.25 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.131749 Apr 20 18:27:47.295997 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 32/65] 10.222.0.25 () {58 vars in 1124 bytes} [Tue Apr 20 18:27:47 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:29:17.861683 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-4cfbe7d0-6fb5-447b-8b30-9db6b481c56c admin admin] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:17.862754 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-4cfbe7d0-6fb5-447b-8b30-9db6b481c56c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Apr 20 18:29:17.863186 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 34/66] 10.222.0.25 () {56 vars in 1065 bytes} [Tue Apr 20 18:29:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:29:18.123341 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-f958055c-39a6-43c3-a07e-5cb9ce55869c admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:18.125246 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:29:18.125246 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: warnings.warn(msg) Apr 20 18:29:18.126918 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-f958055c-39a6-43c3-a07e-5cb9ce55869c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:18.127397 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-f958055c-39a6-43c3-a07e-5cb9ce55869c admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=85704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:18.128230 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-f958055c-39a6-43c3-a07e-5cb9ce55869c admin admin] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:18.128698 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-f958055c-39a6-43c3-a07e-5cb9ce55869c admin admin] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=85704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:18.161692 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-f958055c-39a6-43c3-a07e-5cb9ce55869c admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.170206 Apr 20 18:29:18.162291 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1184 bytes} [Tue Apr 20 18:29:17 2021] GET /compute/v2.1/os-services => generated 791 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:29:19.754795 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-4cfbe7d0-6fb5-447b-8b30-9db6b481c56c admin admin] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:19.755850 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-4cfbe7d0-6fb5-447b-8b30-9db6b481c56c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Apr 20 18:29:19.756277 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 35/68] 10.222.0.25 () {56 vars in 1065 bytes} [Tue Apr 20 18:29:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:29:19.940655 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-a095d436-bb1a-4152-9531-e50c0fd0b285 admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:19.942038 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:29:19.942038 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: warnings.warn(msg) Apr 20 18:29:19.943787 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-a095d436-bb1a-4152-9531-e50c0fd0b285 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:19.944277 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-a095d436-bb1a-4152-9531-e50c0fd0b285 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=85704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:19.945163 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-a095d436-bb1a-4152-9531-e50c0fd0b285 admin admin] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:19.945661 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-a095d436-bb1a-4152-9531-e50c0fd0b285 admin admin] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=85704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:19.975283 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-a095d436-bb1a-4152-9531-e50c0fd0b285 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.089714 Apr 20 18:29:19.975819 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 34/69] 10.222.0.25 () {60 vars in 1184 bytes} [Tue Apr 20 18:29:19 2021] GET /compute/v2.1/os-services => generated 791 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:29:32.046715 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-4cfbe7d0-6fb5-447b-8b30-9db6b481c56c admin admin] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:32.047794 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-4cfbe7d0-6fb5-447b-8b30-9db6b481c56c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002101 Apr 20 18:29:32.048234 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 36/70] 10.222.0.25 () {56 vars in 1065 bytes} [Tue Apr 20 18:29:32 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:29:32.236204 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-5a02b6b2-2911-4b3f-b955-1550b36686d9 admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:32.237575 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:29:32.237575 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: warnings.warn(msg) Apr 20 18:29:32.239288 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-5a02b6b2-2911-4b3f-b955-1550b36686d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:32.239785 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-5a02b6b2-2911-4b3f-b955-1550b36686d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=85704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:32.240681 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-5a02b6b2-2911-4b3f-b955-1550b36686d9 admin admin] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:32.241113 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-5a02b6b2-2911-4b3f-b955-1550b36686d9 admin admin] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=85704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:32.274977 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-5a02b6b2-2911-4b3f-b955-1550b36686d9 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.094609 Apr 20 18:29:32.275615 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 35/71] 10.222.0.25 () {60 vars in 1184 bytes} [Tue Apr 20 18:29:32 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:29:33.898256 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-4cfbe7d0-6fb5-447b-8b30-9db6b481c56c admin admin] Calling method '>' {{(pid=85705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:33.899411 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-4cfbe7d0-6fb5-447b-8b30-9db6b481c56c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Apr 20 18:29:33.899836 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85705|app: 0|req: 37/72] 10.222.0.25 () {56 vars in 1065 bytes} [Tue Apr 20 18:29:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:29:34.089638 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG nova.api.openstack.wsgi [None req-c83485f3-c101-4b2e-8938-54870517e4e3 admin admin] Calling method '>' {{(pid=85704) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:29:34.090987 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:29:34.090987 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: warnings.warn(msg) Apr 20 18:29:34.092648 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-c83485f3-c101-4b2e-8938-54870517e4e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:34.093296 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-c83485f3-c101-4b2e-8938-54870517e4e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=85704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:34.094325 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-c83485f3-c101-4b2e-8938-54870517e4e3 admin admin] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=85704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:29:34.094800 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: DEBUG oslo_concurrency.lockutils [None req-c83485f3-c101-4b2e-8938-54870517e4e3 admin admin] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=85704) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:29:34.123046 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: INFO nova.api.openstack.requestlog [None req-c83485f3-c101-4b2e-8938-54870517e4e3 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.094610 Apr 20 18:29:34.123580 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: [pid: 85704|app: 0|req: 36/73] 10.222.0.25 () {60 vars in 1184 bytes} [Tue Apr 20 18:29:34 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:30:33.064602 dv-cinder-786932-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 20 18:30:33.065632 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: Tue Apr 20 18:30:33 2021 - graceful shutdown triggered... Apr 20 18:30:33.066113 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: Gracefully killing worker 2 (pid: 85705)... Apr 20 18:30:33.066312 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: Gracefully killing worker 1 (pid: 85704)... Apr 20 18:30:34.066801 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: worker 1 buried after 1 seconds Apr 20 18:30:34.066801 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: worker 2 buried after 1 seconds Apr 20 18:30:34.066801 dv-cinder-786932-2-iscsi devstack@n-api.service[85703]: goodbye to uWSGI. Apr 20 18:30:34.068635 dv-cinder-786932-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 20 18:30:34.070787 dv-cinder-786932-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 20 18:30:34.079745 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 20 18:30:34.081779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: *** Starting uWSGI 2.0.15-debian (64bit) on [Tue Apr 20 18:30:34 2021] *** Apr 20 18:30:34.081779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Apr 20 18:30:34.081779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Apr 20 18:30:34.081779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: nodename: dv-cinder-786932-2-iscsi Apr 20 18:30:34.081779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: machine: x86_64 Apr 20 18:30:34.081779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: clock source: unix Apr 20 18:30:34.081779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: pcre jit disabled Apr 20 18:30:34.081779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: detected number of CPU cores: 4 Apr 20 18:30:34.081779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: current working directory: / Apr 20 18:30:34.081779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: detected binary path: /usr/bin/uwsgi-core Apr 20 18:30:34.081779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: dropping root privileges as early as possible Apr 20 18:30:34.081779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: your processes number limit is 47843 Apr 20 18:30:34.081779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: your memory page size is 4096 bytes Apr 20 18:30:34.081779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: detected max file descriptor number: 2048 Apr 20 18:30:34.081779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: lock engine: pthread robust mutexes Apr 20 18:30:34.084178 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: thunder lock: enabled Apr 20 18:30:34.084178 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 20 18:30:34.084178 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: dropping root privileges after socket binding Apr 20 18:30:34.084178 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Apr 20 18:30:34.133718 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: Python main interpreter initialized at 0x558a8ed6d9c0 Apr 20 18:30:34.133718 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: dropping root privileges after plugin initialization Apr 20 18:30:34.133718 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: python threads support enabled Apr 20 18:30:34.133718 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: your server socket listen backlog is limited to 100 connections Apr 20 18:30:34.133718 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: your mercy for graceful operations on workers is 90 seconds Apr 20 18:30:34.134548 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: mapped 402621 bytes (393 KB) for 2 cores Apr 20 18:30:34.134548 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: *** Operational MODE: preforking *** Apr 20 18:30:34.134548 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: dropping root privileges after application loading Apr 20 18:30:34.134548 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: *** uWSGI is running in multiple interpreter mode *** Apr 20 18:30:34.134548 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: spawned uWSGI master process (pid: 100590) Apr 20 18:30:34.153919 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: spawned uWSGI worker 1 (pid: 100592, cores: 1) Apr 20 18:30:34.153919 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: spawned uWSGI worker 2 (pid: 100593, cores: 1) Apr 20 18:30:34.153919 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 20 18:30:34.134727 dv-cinder-786932-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 20 18:30:40.311126 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 20 18:30:40.312071 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 20 18:30:40.315045 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 20 18:30:40.315849 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 20 18:30:40.316352 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 20 18:30:40.317189 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.317930 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.318599 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.319257 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.319933 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.320579 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.321274 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.321949 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.322675 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.323103 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.323722 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.324360 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786932-2-iscsi {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.325096 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.326310 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.326963 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.327640 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.328283 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.328960 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.329652 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.330938 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.331605 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.332220 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.332876 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.333895 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.334295 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.334934 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.335707 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.336281 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.336971 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.337668 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.338336 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786932-2-iscsi {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.339023 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.339672 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.340292 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.341174 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.342410 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.343079 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.343789 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.344491 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.345167 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.345919 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.346601 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.347181 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.347786 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.348343 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.348910 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.349585 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.350277 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.350917 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.351534 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.352069 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.352708 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.353361 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.354042 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.354686 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.355235 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.355774 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.356472 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.357269 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.357944 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.358872 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.359543 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.360142 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.360800 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.361452 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.362057 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.362695 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.363392 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.364092 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.364867 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.365581 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.366281 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.367168 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.367720 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.368388 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.369149 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.369860 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.370514 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.371254 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.371965 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.373172 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.373867 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.374537 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.375861 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.376070 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.376591 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.377992 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.377992 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.378453 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.379104 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.379783 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.380453 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.381117 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.381807 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.382470 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.383129 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.383750 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.384409 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.385078 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.385772 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.386376 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.387006 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.387655 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.388915 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.389651 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.390309 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.390971 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.391639 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.392289 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.392979 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.393679 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.394300 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.395000 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.395670 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.396343 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.397032 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.397704 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.398358 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.399047 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.399704 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.400368 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.401062 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.401767 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.402402 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.403039 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.403684 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.404367 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.405228 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.405924 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.406574 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.407388 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.408078 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.408761 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.409411 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.410076 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.410727 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.411431 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:40.412103 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.412810 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.413586 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.414284 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.415002 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.415725 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.416403 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.417074 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.417792 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.418504 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.419174 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.419919 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.420598 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.421300 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.422045 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.422791 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.423471 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.424153 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.424855 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.425602 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.426297 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.427042 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.427764 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.428440 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.429212 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.430012 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.430720 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.431457 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.432157 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.432839 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.433591 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.434234 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.434909 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.436125 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.436826 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.437533 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.438264 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.438935 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.439616 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.440275 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.440929 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.441628 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.442241 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.442815 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.443459 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.444034 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.444562 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.445178 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.445725 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.446315 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.446919 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.447530 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.448130 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.448768 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.449367 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.449998 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.450583 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.451785 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.452368 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.452922 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.453494 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.454071 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.454616 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.455183 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.455743 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.456333 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.456884 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.457554 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.458282 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.459012 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.459650 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.460356 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.461049 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.461771 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.462430 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.463102 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.463769 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.464439 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.465082 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.465798 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.466505 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.467177 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.467815 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.468475 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.469129 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.469879 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.470543 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.471209 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.471849 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.472498 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.473229 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.473903 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.474517 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.475090 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.475670 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.476232 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.476777 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.477320 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.477892 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.478444 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.479035 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.479688 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.480327 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.480969 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.481670 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.482418 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.483170 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.484105 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.484779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.485495 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.486158 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.486832 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.487485 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.488143 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.488809 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.489519 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.490199 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.490812 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.491431 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.492039 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.492697 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.493475 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.494114 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.494760 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.495460 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.496209 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.496913 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.498211 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.498939 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.499613 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.500284 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.501326 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.502032 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.502692 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.503362 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.504013 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.504789 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.505507 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.506197 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.506874 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.507559 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.508243 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.508949 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.509663 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.510349 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.511045 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.511702 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.512368 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.513006 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.514658 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.515874 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.516822 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.517856 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.518801 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.519749 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.520663 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.521670 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.522615 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.523577 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.525180 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.526179 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.527207 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.527935 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.528651 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.530003 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.530755 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.531433 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.532064 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.532732 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.533449 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.534113 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.534772 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.535463 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.536135 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.536816 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.537553 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.538239 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.538919 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.539559 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.540232 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.540905 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.541640 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.542356 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.543321 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.543824 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.544580 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.545249 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.546181 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.546455 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.547359 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.548273 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.549078 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.550072 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.550971 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.551946 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.552838 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.553741 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.555425 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.556124 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.556797 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.557518 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.558199 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.558867 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.559524 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.560760 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.561422 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.562012 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.562675 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.563334 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.564011 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.564669 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.565349 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.566038 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.566715 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.567419 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.568070 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.568786 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.569493 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.570160 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.570837 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.571501 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.572155 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.572811 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.573454 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.574080 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.574705 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.575325 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.576889 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.577924 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.578600 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.579284 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.579962 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.580615 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.581278 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.581993 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.582647 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.583353 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.584021 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.584685 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.585343 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.586041 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.586817 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.587484 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.588292 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.588965 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.589686 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.590394 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.591078 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.591802 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.592422 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.593093 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.593830 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.594456 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.595099 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.595814 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.596492 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.597192 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.597976 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.598699 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.599446 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.600076 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.600903 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.601338 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.602206 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.603109 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.603777 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.604453 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.605162 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.605828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.606455 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.607500 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.607837 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.608756 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.609423 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.610140 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.610866 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.611541 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.612300 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.612952 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.613670 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.614353 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.615027 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.615990 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.616683 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.617356 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.618083 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.621462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.621462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.621462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.621462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.621462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.622413 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.623545 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.624210 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.624872 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.625536 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.626199 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.626881 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.627607 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.628273 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.628960 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.629695 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.630407 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.631090 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.631816 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.632778 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.633498 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.634183 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.635100 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.635787 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.636455 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.637107 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.637803 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.639071 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.639746 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.640406 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.641309 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.642101 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.642810 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.643479 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.644146 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.644809 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.647474 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.647474 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.647474 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.648246 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.648882 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.649630 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.650263 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.650933 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.652358 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.652358 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.652846 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.656407 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.657862 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.658265 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.659446 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.660737 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.662004 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.662197 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.662739 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.663419 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.664059 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.664776 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.665466 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.666150 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.666830 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.667511 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.668064 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.668575 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.669451 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.670601 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.671268 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.671934 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.672596 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.673317 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.674498 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.675160 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.675843 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.676546 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.677209 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.679348 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.679707 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.680383 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.681079 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.681847 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.682511 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.683183 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.683851 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.684506 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.685220 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.685915 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.686567 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.687187 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.687797 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.688262 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.688816 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.689315 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.690328 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.690922 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.691509 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.692006 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.692634 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.693500 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.694105 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.694831 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.695532 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.696204 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.697025 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.697583 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.698243 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.698862 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.699483 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.700139 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.701345 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.702678 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.702678 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.703255 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.703889 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.704581 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.705255 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.705983 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.707144 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.707983 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.708424 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.709783 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.710362 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.710912 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.711506 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.712507 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.712704 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.713168 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.714199 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.714769 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.715314 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.715935 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.717153 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.717712 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.718479 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.719953 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.720962 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.721337 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.721997 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.722593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.723130 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.724160 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.724989 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.726306 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.726306 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.726841 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.727493 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.729134 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.729134 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.729989 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.730532 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.731096 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.731685 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.733089 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.735166 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.735746 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.737260 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.739508 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.740757 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.741056 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.741668 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.742230 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.742975 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.743463 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.744318 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.745225 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.745636 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.746925 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.746925 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.747281 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.750520 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.750520 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.750520 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.750520 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.751050 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.751736 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.752341 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.752899 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.753586 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.754289 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.755514 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.755960 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.756563 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.757152 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.757755 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.759027 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.759027 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.759829 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.760375 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.761528 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.762156 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.762674 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.763861 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.763861 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.765007 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.765629 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.766162 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.766785 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.767348 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.767891 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.768639 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.769047 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.775044 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.775044 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.775044 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.775044 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.775044 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.775044 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.775044 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.776874 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.776874 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.776874 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.777664 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.777918 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.778585 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.779195 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.780274 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.780800 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.781724 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.782308 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.782850 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.783686 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.784274 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.785171 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.785752 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.789467 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.789467 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.789467 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.789467 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.789467 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.789467 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.789467 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.789467 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.791994 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.791994 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.791994 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.792757 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.792757 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.793492 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.795430 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.796006 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.796543 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.797079 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.798097 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.798387 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.798989 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.799500 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.800428 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.800915 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.802114 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.802528 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.803073 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.803596 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.804290 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.804828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.805539 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.806017 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.806749 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.807242 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.807801 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.808383 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.808941 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.809648 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.811607 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.812908 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.813190 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.813719 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.814296 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.814873 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.815433 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.816061 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.816617 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.817166 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.817990 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.818540 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.819071 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.819872 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.820960 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.820960 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.821898 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.822709 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.823621 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.823902 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.824711 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.825057 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.826377 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.826929 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.827433 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.827963 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.828511 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.829042 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.829719 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.830260 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.830803 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.831768 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.832099 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.832882 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.833472 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.834014 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.834560 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.835724 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.835724 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.836321 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.836948 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.837631 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.838190 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.838709 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.839297 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.840171 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.840659 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.841199 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.842776 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.843389 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.844923 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.844923 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.845538 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.845856 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.846632 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.847102 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.847951 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.849149 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.849819 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.850671 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.851457 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.851809 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.852617 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.853337 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:40.853840 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100593) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 20 18:30:40.907063 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_db.sqlalchemy.engines [None req-62f1fcd3-1d74-4abb-8fef-f24835111304 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100593) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:30:41.236361 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.context [None req-62f1fcd3-1d74-4abb-8fef-f24835111304 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d5aad75-0cd5-4608-84e6-b1adec1c0420(cell1) {{(pid=100593) load_cells /opt/stack/nova/nova/context.py:466}} Apr 20 18:30:41.241736 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-62f1fcd3-1d74-4abb-8fef-f24835111304 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:30:41.244606 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-62f1fcd3-1d74-4abb-8fef-f24835111304 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:30:41.244874 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-62f1fcd3-1d74-4abb-8fef-f24835111304 None None] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:30:41.247361 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-62f1fcd3-1d74-4abb-8fef-f24835111304 None None] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:30:41.283695 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_db.sqlalchemy.engines [None req-62f1fcd3-1d74-4abb-8fef-f24835111304 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100593) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:30:41.284685 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_db.sqlalchemy.engines [None req-62f1fcd3-1d74-4abb-8fef-f24835111304 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100593) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:30:41.321915 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_db.sqlalchemy.engines [None req-62f1fcd3-1d74-4abb-8fef-f24835111304 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100593) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:30:41.413094 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Apr 20 18:30:41.413483 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Apr 20 18:30:41.415186 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Apr 20 18:30:41.415653 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Apr 20 18:30:41.415959 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Apr 20 18:30:41.416518 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.416974 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.417351 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.417757 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.418154 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.418516 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.418895 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.419269 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.419742 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.420047 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.420420 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.420798 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786932-2-iscsi {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.421183 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.421569 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.421939 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.422325 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.422680 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.423059 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.423418 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.424050 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.424412 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.424772 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.425142 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.425578 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.425951 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.426316 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.433414 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.433414 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.433414 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.433414 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.433414 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786932-2-iscsi {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.433414 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.433414 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.433414 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.434052 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.434052 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.434052 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.434052 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.434052 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.434052 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.434052 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.434052 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.434593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.434593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.434593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.434593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.434593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.434593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.434593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.435738 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.436864 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.436864 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.436864 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.437250 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.438189 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.438384 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.438891 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.439305 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.439726 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.440099 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.440478 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.440843 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.441209 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.441607 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.441973 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.442335 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.442698 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.442935 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 18:30:41.442935 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: from cryptography.utils import int_from_bytes Apr 20 18:30:41.443272 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.443418 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.444500 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 18:30:41.444500 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: from cryptography.utils import int_from_bytes Apr 20 18:30:41.445542 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.445794 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.446202 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.446705 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.447011 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.447447 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.447765 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.448153 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.448525 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.448911 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.449324 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.449697 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.450061 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.450427 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.451536 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.452022 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.452378 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.452688 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.453044 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.453516 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.453892 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.454248 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.454610 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.454976 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.455332 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.455694 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.456057 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.456420 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.456789 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.457148 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.457572 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.457933 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.458292 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.458649 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.459032 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.459417 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.459776 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.460136 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.460495 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.460851 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.461235 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.461625 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.461985 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.462368 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.462727 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.463084 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.463521 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.463798 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.464161 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.464768 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.465077 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.469423 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.469423 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.469423 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.469423 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.469423 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.469423 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.469423 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.469423 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.470806 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.470806 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.470806 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.470806 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.470806 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.470806 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.470806 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.470806 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.471908 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Apr 20 18:30:41.471908 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.471908 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.471908 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.472503 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.472666 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.473011 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.473369 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.473803 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.474220 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.474562 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.474961 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.475361 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.475736 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.476153 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.476528 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.476927 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.477296 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.477697 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.478070 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.478434 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.478805 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.479193 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.479570 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.479935 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.480340 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.480744 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.481112 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.481535 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.482467 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.482858 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.483275 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.483984 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.484352 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.484724 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.485094 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.485502 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.485911 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.486287 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.486738 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.487039 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.487329 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.487686 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.488051 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.488408 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.488859 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.489249 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.489665 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.490082 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.490443 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.490810 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.491175 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.491535 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.491901 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.492264 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.492624 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.493006 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.493370 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.493751 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.494128 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.494486 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.494844 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.495225 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.495588 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.495950 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.496313 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.496698 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.497075 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.497440 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.498659 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.499188 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.499552 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.499946 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.500330 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.500708 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.501067 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.501455 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.501819 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.502180 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.502539 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.502902 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.503292 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.503651 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.504006 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.504365 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.504724 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.505115 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.505562 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.505844 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.506204 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.506564 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.506981 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.507342 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.507761 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.508110 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.508490 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.508865 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.509229 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.509619 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.509980 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.510346 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.510732 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.511091 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.511456 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.511849 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.512213 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.512593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.512989 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.513469 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.513844 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.514219 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.514583 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.514957 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.515321 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.515764 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.516019 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.516383 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.516754 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.517120 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.517510 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.517869 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.518239 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.518604 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.518961 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.519320 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.519688 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.520076 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.520445 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.520824 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.521277 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.521673 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.522034 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.522653 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.523023 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.523386 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.523746 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.524106 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.524523 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.524897 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.525256 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.525656 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.526035 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.526399 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.526774 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.527139 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.527526 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.527887 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.528258 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.528620 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.529031 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.529488 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.529807 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.530162 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.530546 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.530910 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.531276 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.531640 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.531995 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.532358 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.532728 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.533501 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.533900 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.534277 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.534660 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.535031 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.535406 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.535805 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.536201 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.536569 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.536931 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.537299 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.537688 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.538048 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.538413 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.538774 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.539135 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.539501 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.539863 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.540224 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.540583 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.540970 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.541329 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.541740 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.542098 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.542464 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.542827 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.543297 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.543688 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.544056 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.545133 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.545372 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.545817 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.546168 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.546575 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.546963 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.547369 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.547732 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.548090 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.548476 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.548837 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.549195 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.549586 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.549949 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.550310 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.550675 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.551051 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.551414 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.551769 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.552134 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.552489 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.552863 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.553223 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.553609 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.553966 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.554330 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.554692 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.555055 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.555443 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.555808 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.556165 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.556538 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.556884 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.557241 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.557627 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.558012 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.558387 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.558747 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.559106 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.559468 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.559827 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.560743 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.561115 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.561517 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.561873 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.562230 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.562588 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.562947 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.563335 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.563699 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.564056 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.564416 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.564798 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.565173 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.565582 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.566024 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.566384 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.566756 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.567148 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.567519 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.567878 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.568249 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.568615 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.568986 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.569346 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.569737 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.569851 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO keyring.backend [None req-62f1fcd3-1d74-4abb-8fef-f24835111304 None None] Loading Gnome Apr 20 18:30:41.570122 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.570489 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.570860 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.571242 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.571625 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.572011 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.572370 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.572735 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.573101 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.573490 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.573862 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.574225 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.574591 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.574965 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.575331 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.575726 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.576100 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.576470 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.577269 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.577886 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.578463 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.578863 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.579233 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.579595 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.579959 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.580320 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.580689 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.581050 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.581599 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.581969 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.582337 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.582695 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.583063 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.583430 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.583802 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.584176 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.584537 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.585047 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.585449 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.585807 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.586175 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.586536 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.586894 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.587258 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.587648 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.588009 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.588369 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.588729 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.589115 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.589504 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.589889 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.590398 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.590764 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.591124 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.591657 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.592024 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.592390 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.592762 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.593146 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.593577 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.593940 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.594311 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.594684 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.595071 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.595461 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.595829 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.596201 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.596562 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.596949 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.597335 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.597739 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.598121 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.598627 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.599009 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.599378 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.599764 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.600147 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.600506 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.600864 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.600975 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO keyring.backend [None req-62f1fcd3-1d74-4abb-8fef-f24835111304 None None] Loading Google Apr 20 18:30:41.601229 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.601620 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.601983 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.602371 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.602732 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.603100 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.603465 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.603829 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.604213 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.604576 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.604957 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.605316 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.605722 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO keyring.backend [None req-62f1fcd3-1d74-4abb-8fef-f24835111304 None None] Loading Windows (alt) Apr 20 18:30:41.605829 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.606082 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.606465 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.607411 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.607790 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.608177 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.608784 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.609145 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.609526 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.609888 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.610297 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.610658 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.611035 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.611427 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.611818 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.612183 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.612579 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.612962 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.613332 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.613740 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.613975 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO keyring.backend [None req-62f1fcd3-1d74-4abb-8fef-f24835111304 None None] Loading file Apr 20 18:30:41.614154 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.614517 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.614879 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.615251 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.615550 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO keyring.backend [None req-62f1fcd3-1d74-4abb-8fef-f24835111304 None None] Loading keyczar Apr 20 18:30:41.615655 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.615942 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.616162 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO keyring.backend [None req-62f1fcd3-1d74-4abb-8fef-f24835111304 None None] Loading multi Apr 20 18:30:41.616303 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.616667 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.617026 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.617432 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.617601 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO keyring.backend [None req-62f1fcd3-1d74-4abb-8fef-f24835111304 None None] Loading pyfs Apr 20 18:30:41.617755 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.618123 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.618484 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.618867 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.619234 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.619593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.619951 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.620310 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.620723 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.621083 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.621528 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.621909 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.622289 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.622745 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.623120 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.623509 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.623872 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.624243 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.624613 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.624988 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.625360 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.625759 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.626128 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.626493 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.626866 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.627234 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.627608 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.628282 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.628669 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.629040 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.629462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.629818 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.630194 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.630562 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.630931 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.631322 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.631686 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.632052 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.632446 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.632835 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.633227 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.633659 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.634036 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.634411 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.634774 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.635151 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.635587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.635960 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.636322 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.636696 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.637072 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.637491 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.637864 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.638770 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.639149 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.639526 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.639888 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.640251 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.640617 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.640985 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.641381 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.641809 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.642187 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.642555 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.642922 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.643290 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.643944 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.644312 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.644708 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.645092 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.645501 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.645875 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.646249 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.646633 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.646994 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.647352 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.647717 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.648081 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.648439 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.648820 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.649185 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.649597 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.649964 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.650317 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.650986 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.651406 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.651777 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.652165 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.652551 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.652921 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.653281 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.654468 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.654734 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.655026 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.655566 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.655936 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.656295 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.656655 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.657020 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.657383 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.657765 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.658128 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.658485 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.658873 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.659233 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.659590 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.659949 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.660314 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.660671 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.661029 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.661406 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.661770 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.662141 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.662499 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.662861 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.663222 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.663587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.663950 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.664315 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.664675 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.665075 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.665460 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.665822 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.666201 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.666564 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.666948 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.667315 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.667679 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.668097 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.668471 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.669152 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.670203 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.670785 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.671190 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.671593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.671981 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.672344 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.672704 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.673087 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.673478 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.673848 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.674213 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.674576 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.674939 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.675302 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.675673 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.676037 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.676402 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.676767 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.677176 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.677578 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.677954 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.678325 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.678697 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.679064 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.679427 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.679790 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.680157 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.680524 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.680923 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.681293 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.681683 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.682200 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.682571 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.682947 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.683326 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.683691 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.684081 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.684483 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.684877 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.685901 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.686273 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.686628 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.686984 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.687351 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.687764 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.688165 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.688541 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.688922 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.689313 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.689713 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.690079 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.690446 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.690812 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.691179 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.691555 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.691931 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.692305 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.692671 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.693057 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.693455 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.693837 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.694198 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.694569 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.694933 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.695302 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.695709 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.696080 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.696463 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.696829 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.697211 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.697623 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.698008 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.698391 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.698770 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.699135 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.699525 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.699889 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.700257 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.701152 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.701563 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.701936 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.702292 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.702683 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.703070 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.703430 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.703816 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.704191 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.704569 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.704941 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.705307 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.705749 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.706115 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.706487 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.706851 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.707218 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.707590 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.707961 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.708346 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.708729 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.709116 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.709552 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.709972 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.710341 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.710758 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.711173 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:30:41.711433 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100592) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Apr 20 18:30:41.753009 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_db.sqlalchemy.engines [None req-943084a1-a147-404b-b7ee-4e7a8bde4dab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100592) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:30:41.942409 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: WARNING keystonemiddleware.auth_token [None req-62f1fcd3-1d74-4abb-8fef-f24835111304 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 18:30:41.949974 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: WARNING keystonemiddleware.auth_token [None req-62f1fcd3-1d74-4abb-8fef-f24835111304 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 18:30:42.055331 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.context [None req-943084a1-a147-404b-b7ee-4e7a8bde4dab None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d5aad75-0cd5-4608-84e6-b1adec1c0420(cell1) {{(pid=100592) load_cells /opt/stack/nova/nova/context.py:466}} Apr 20 18:30:42.063260 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-943084a1-a147-404b-b7ee-4e7a8bde4dab None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:30:42.066308 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-943084a1-a147-404b-b7ee-4e7a8bde4dab None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:30:42.067527 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-943084a1-a147-404b-b7ee-4e7a8bde4dab None None] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:30:42.070600 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-943084a1-a147-404b-b7ee-4e7a8bde4dab None None] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:30:42.105062 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_db.sqlalchemy.engines [None req-943084a1-a147-404b-b7ee-4e7a8bde4dab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100592) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:30:42.106087 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_db.sqlalchemy.engines [None req-943084a1-a147-404b-b7ee-4e7a8bde4dab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100592) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:30:42.145176 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_db.sqlalchemy.engines [None req-943084a1-a147-404b-b7ee-4e7a8bde4dab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=100592) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 20 18:30:42.269122 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 18:30:42.269122 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: from cryptography.utils import int_from_bytes Apr 20 18:30:42.269910 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 20 18:30:42.269910 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: from cryptography.utils import int_from_bytes Apr 20 18:30:42.304740 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: WARNING keystonemiddleware.auth_token [None req-62f1fcd3-1d74-4abb-8fef-f24835111304 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 18:30:42.311123 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: WARNING keystonemiddleware.auth_token [None req-62f1fcd3-1d74-4abb-8fef-f24835111304 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 18:30:42.317110 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x558a8ed6d9c0 pid: 100593 (default app) Apr 20 18:30:42.357178 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO keyring.backend [None req-943084a1-a147-404b-b7ee-4e7a8bde4dab None None] Loading Gnome Apr 20 18:30:42.380553 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO keyring.backend [None req-943084a1-a147-404b-b7ee-4e7a8bde4dab None None] Loading Google Apr 20 18:30:42.384288 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO keyring.backend [None req-943084a1-a147-404b-b7ee-4e7a8bde4dab None None] Loading Windows (alt) Apr 20 18:30:42.390153 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO keyring.backend [None req-943084a1-a147-404b-b7ee-4e7a8bde4dab None None] Loading file Apr 20 18:30:42.391347 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO keyring.backend [None req-943084a1-a147-404b-b7ee-4e7a8bde4dab None None] Loading keyczar Apr 20 18:30:42.391814 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO keyring.backend [None req-943084a1-a147-404b-b7ee-4e7a8bde4dab None None] Loading multi Apr 20 18:30:42.392744 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO keyring.backend [None req-943084a1-a147-404b-b7ee-4e7a8bde4dab None None] Loading pyfs Apr 20 18:30:42.692171 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: WARNING keystonemiddleware.auth_token [None req-943084a1-a147-404b-b7ee-4e7a8bde4dab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 18:30:42.699822 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: WARNING keystonemiddleware.auth_token [None req-943084a1-a147-404b-b7ee-4e7a8bde4dab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 18:30:43.053284 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: WARNING keystonemiddleware.auth_token [None req-943084a1-a147-404b-b7ee-4e7a8bde4dab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 18:30:43.059435 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: WARNING keystonemiddleware.auth_token [None req-943084a1-a147-404b-b7ee-4e7a8bde4dab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 18:30:43.065706 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: WSGI app 0 (mountpoint='') ready in 9 seconds on interpreter 0x558a8ed6d9c0 pid: 100592 (default app) Apr 20 18:31:26.974006 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c67b17b9-8881-4a42-858b-aac702a3a39c tempest-VolumesGetTestJSON-1040841746 tempest-VolumesGetTestJSON-1040841746-project] Action: 'create', calling method: .version_select at 0x7f418ed482f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-430746850", "metadata": {"Type": "work"}}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:31:27.000316 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b240d185-6f3b-4d1d-853c-f34921b7f140 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] Action: 'create', calling method: .version_select at 0x7f418ed462f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-528360649"}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:31:29.124185 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c67b17b9-8881-4a42-858b-aac702a3a39c tempest-VolumesGetTestJSON-1040841746 tempest-VolumesGetTestJSON-1040841746-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.703780 Apr 20 18:31:29.125342 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Apr 20 18:31:24 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 4707 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 20 18:31:29.610742 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e3c4ba3f-10cb-4502-9104-bdcea8f74d32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1676722417", "imageRef": "ba8326d8-5d1b-42a2-a65e-f1108a025e30", "flavorRef": "452", "networks": [{"uuid": "cc0a5556-9f4f-4012-a49b-d7d22905fe39"}]}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:31:29.769110 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b240d185-6f3b-4d1d-853c-f34921b7f140 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.158174 Apr 20 18:31:29.769860 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 1/2] 10.222.0.25 () {60 vars in 1145 bytes} [Tue Apr 20 18:31:25 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 4161 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Apr 20 18:31:29.775823 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b0815dde-a463-4cf5-bf7d-7dc89e51713f tempest-VolumesGetTestJSON-1040841746 tempest-VolumesGetTestJSON-1040841746-project] Calling method '.version_select at 0x7f418ed46b70>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:30.021255 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.network.neutron [None req-e3c4ba3f-10cb-4502-9104-bdcea8f74d32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] validate_networks() for [('cc0a5556-9f4f-4012-a49b-d7d22905fe39', None, None, None)] {{(pid=100593) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:31:30.031809 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b0815dde-a463-4cf5-bf7d-7dc89e51713f tempest-VolumesGetTestJSON-1040841746 tempest-VolumesGetTestJSON-1040841746-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/514aa4b3-ba0e-4c97-a00c-b9ca221876e9" status: 200 len: 352 microversion: 2.1 time: 0.260411 Apr 20 18:31:30.032972 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Apr 20 18:31:29 2021] GET /compute/v2.1/os-volumes/514aa4b3-ba0e-4c97-a00c-b9ca221876e9 => generated 352 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:31:30.038116 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4de4276f-d231-4a54-bd99-6b0c241e0c34 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] Calling method '.version_select at 0x7f418ed08d08>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:30.356465 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4de4276f-d231-4a54-bd99-6b0c241e0c34 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/971b1614-c541-48dc-a2f9-192a89954cf7" status: 200 len: 344 microversion: 2.1 time: 0.321443 Apr 20 18:31:30.357226 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 3/4] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Apr 20 18:31:30 2021] GET /compute/v2.1/os-volumes/971b1614-c541-48dc-a2f9-192a89954cf7 => generated 344 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:31:30.857560 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f82a4151-5396-41c2-a619-160de277d52e tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-235987728", "imageRef": "ba8326d8-5d1b-42a2-a65e-f1108a025e30", "flavorRef": "452", "networks": [{"uuid": "a4e74e02-5162-4969-a5ab-fa33f8684bda"}]}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:31:31.099697 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.network.neutron [None req-f82a4151-5396-41c2-a619-160de277d52e tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] validate_networks() for [('a4e74e02-5162-4969-a5ab-fa33f8684bda', None, None, None)] {{(pid=100592) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:31:33.494085 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-e3c4ba3f-10cb-4502-9104-bdcea8f74d32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Flavor limits 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:31:33.497812 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-e3c4ba3f-10cb-4502-9104-bdcea8f74d32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Image limits 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:31:33.498686 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-e3c4ba3f-10cb-4502-9104-bdcea8f74d32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Flavor pref 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:31:33.499788 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-e3c4ba3f-10cb-4502-9104-bdcea8f74d32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Image pref 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:31:33.500467 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-e3c4ba3f-10cb-4502-9104-bdcea8f74d32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:31:33.513984 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e3c4ba3f-10cb-4502-9104-bdcea8f74d32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:33.514900 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e3c4ba3f-10cb-4502-9104-bdcea8f74d32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:33.516004 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e3c4ba3f-10cb-4502-9104-bdcea8f74d32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:33.517096 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e3c4ba3f-10cb-4502-9104-bdcea8f74d32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:33.549926 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-e3c4ba3f-10cb-4502-9104-bdcea8f74d32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Getting quotas for project 122aac624a214c548b32893da89374a1. Resources: {'instances', 'ram', 'cores'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:31:33.557892 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-e3c4ba3f-10cb-4502-9104-bdcea8f74d32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Getting quotas for user 9b9bccd8af9040fd946ccb99ac8941dd and project 122aac624a214c548b32893da89374a1. Resources: {'instances', 'ram', 'cores'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:31:33.579697 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e3c4ba3f-10cb-4502-9104-bdcea8f74d32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Going to run 1 instances... {{(pid=100593) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:31:33.585308 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e3c4ba3f-10cb-4502-9104-bdcea8f74d32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba8326d8-5d1b-42a2-a65e-f1108a025e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:31:33.713174 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e3c4ba3f-10cb-4502-9104-bdcea8f74d32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.586227 Apr 20 18:31:33.714209 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 2/5] 10.222.0.25 () {60 vars in 1137 bytes} [Tue Apr 20 18:31:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 4588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:31:33.721146 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c5b3d6c5-7448-415e-9a90-470d33507962 tempest-VolumesGetTestJSON-1040841746 tempest-VolumesGetTestJSON-1040841746-project] Calling method '.version_select at 0x7f418eb2c268>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:33.876504 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c5b3d6c5-7448-415e-9a90-470d33507962 tempest-VolumesGetTestJSON-1040841746 tempest-VolumesGetTestJSON-1040841746-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/514aa4b3-ba0e-4c97-a00c-b9ca221876e9" status: 200 len: 353 microversion: 2.1 time: 0.160044 Apr 20 18:31:33.877405 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 3/6] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Apr 20 18:31:33 2021] GET /compute/v2.1/os-volumes/514aa4b3-ba0e-4c97-a00c-b9ca221876e9 => generated 353 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:31:33.883461 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-76b982e1-1bd7-4a23-a02e-71de612d8d34 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] Calling method '.version_select at 0x7f418eb2c840>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:34.293175 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-76b982e1-1bd7-4a23-a02e-71de612d8d34 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/971b1614-c541-48dc-a2f9-192a89954cf7" status: 200 len: 345 microversion: 2.1 time: 0.414132 Apr 20 18:31:34.294829 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Apr 20 18:31:33 2021] GET /compute/v2.1/os-volumes/971b1614-c541-48dc-a2f9-192a89954cf7 => generated 345 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:31:34.332000 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7733ba0c-db2c-4e06-923f-fc4c5cb3cf31 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:34.333249 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7733ba0c-db2c-4e06-923f-fc4c5cb3cf31 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:31:34.503693 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-f82a4151-5396-41c2-a619-160de277d52e tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Flavor limits 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:31:34.506141 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-f82a4151-5396-41c2-a619-160de277d52e tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Image limits 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:31:34.507318 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-f82a4151-5396-41c2-a619-160de277d52e tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Flavor pref 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:31:34.508915 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-f82a4151-5396-41c2-a619-160de277d52e tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Image pref 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:31:34.510098 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-f82a4151-5396-41c2-a619-160de277d52e tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:31:34.534990 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f82a4151-5396-41c2-a619-160de277d52e tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:34.536110 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f82a4151-5396-41c2-a619-160de277d52e tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:34.537992 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f82a4151-5396-41c2-a619-160de277d52e tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:34.539116 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f82a4151-5396-41c2-a619-160de277d52e tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:34.591942 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-f82a4151-5396-41c2-a619-160de277d52e tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Getting quotas for project 02402528c32649b9b9327236ec561e08. Resources: {'instances', 'ram', 'cores'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:31:34.603908 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-f82a4151-5396-41c2-a619-160de277d52e tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Getting quotas for user 4e40470b98564885bb79041cddd975cf and project 02402528c32649b9b9327236ec561e08. Resources: {'instances', 'ram', 'cores'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:31:34.641763 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f82a4151-5396-41c2-a619-160de277d52e tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Going to run 1 instances... {{(pid=100592) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:31:34.648468 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f82a4151-5396-41c2-a619-160de277d52e tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba8326d8-5d1b-42a2-a65e-f1108a025e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100592) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:31:34.873020 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f82a4151-5396-41c2-a619-160de277d52e tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.514021 Apr 20 18:31:34.873940 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 4/8] 10.222.0.25 () {60 vars in 1137 bytes} [Tue Apr 20 18:31:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 4516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:31:34.879668 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3f085fb1-815e-4996-9b08-ad76e5b13cd6 tempest-VolumesGetTestJSON-1040841746 tempest-VolumesGetTestJSON-1040841746-project] Calling method '.version_select at 0x7f418eb2d268>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:35.176268 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3f085fb1-815e-4996-9b08-ad76e5b13cd6 tempest-VolumesGetTestJSON-1040841746 tempest-VolumesGetTestJSON-1040841746-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/514aa4b3-ba0e-4c97-a00c-b9ca221876e9" status: 200 len: 353 microversion: 2.1 time: 0.300977 Apr 20 18:31:35.176913 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 5/9] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Apr 20 18:31:34 2021] GET /compute/v2.1/os-volumes/514aa4b3-ba0e-4c97-a00c-b9ca221876e9 => generated 353 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:31:35.184565 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c32ae184-eacb-4df0-a1c0-0e9af4f6fd12 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] Action: 'create', calling method: .version_select at 0x7f418eb2d840>, body: {"snapshot": {"volume_id": "971b1614-c541-48dc-a2f9-192a89954cf7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-971501860"}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:31:35.820238 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c32ae184-eacb-4df0-a1c0-0e9af4f6fd12 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.642080 Apr 20 18:31:35.821488 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 6/10] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Apr 20 18:31:35 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:31:35.827287 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ec38822f-9f30-4c53-92cc-e8e1d49d51f1 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:35.828857 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ec38822f-9f30-4c53-92cc-e8e1d49d51f1 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:31:36.015559 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ec38822f-9f30-4c53-92cc-e8e1d49d51f1 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:31:36.033270 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ec38822f-9f30-4c53-92cc-e8e1d49d51f1 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1214 microversion: 2.1 time: 0.210432 Apr 20 18:31:36.038909 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 7/11] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:31:35 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1214 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:31:36.047950 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9d3527f4-ba41-4e9d-966e-d86737f891fd tempest-VolumesGetTestJSON-1040841746 tempest-VolumesGetTestJSON-1040841746-project] Calling method '.version_select at 0x7f418eb42950>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:36.143491 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7733ba0c-db2c-4e06-923f-fc4c5cb3cf31 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:31:36.172107 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7733ba0c-db2c-4e06-923f-fc4c5cb3cf31 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 200 len: 1218 microversion: 2.1 time: 1.874768 Apr 20 18:31:36.173092 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 5/12] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:31:34 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 1218 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:31:36.189182 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-39702658-5cd1-47fc-a750-c1fde7f99419 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] Calling method '.version_select at 0x7f418eccdae8>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:36.294371 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9d3527f4-ba41-4e9d-966e-d86737f891fd tempest-VolumesGetTestJSON-1040841746 tempest-VolumesGetTestJSON-1040841746-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/514aa4b3-ba0e-4c97-a00c-b9ca221876e9" status: 202 len: 0 microversion: 2.1 time: 0.250688 Apr 20 18:31:36.296018 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 8/13] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Apr 20 18:31:36 2021] DELETE /compute/v2.1/os-volumes/514aa4b3-ba0e-4c97-a00c-b9ca221876e9 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:31:36.317241 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c198c4c2-ac36-4df2-a2b5-b3fdef388f6c tempest-VolumesGetTestJSON-1040841746 tempest-VolumesGetTestJSON-1040841746-project] Calling method '.version_select at 0x7f418eb4ce18>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:36.358696 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-39702658-5cd1-47fc-a750-c1fde7f99419 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/edeeca01-1dcc-4661-a790-1c8b77bf242e" status: 200 len: 286 microversion: 2.1 time: 0.183963 Apr 20 18:31:36.359640 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 6/14] 10.222.0.25 () {58 vars in 1241 bytes} [Tue Apr 20 18:31:36 2021] GET /compute/v2.1/os-snapshots/edeeca01-1dcc-4661-a790-1c8b77bf242e => generated 286 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:31:36.376398 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ff802a63-64b4-44d1-a169-ae436a7ee4fb tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] Calling method '.version_select at 0x7f418eb2c620>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:36.517731 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ff802a63-64b4-44d1-a169-ae436a7ee4fb tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.147514 Apr 20 18:31:36.518340 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 7/15] 10.222.0.25 () {58 vars in 1130 bytes} [Tue Apr 20 18:31:36 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:31:36.533543 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e94d952e-2cb9-41d9-aab5-c342f014bf39 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] Calling method '.version_select at 0x7f418e2e4730>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:36.735365 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e94d952e-2cb9-41d9-aab5-c342f014bf39 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/edeeca01-1dcc-4661-a790-1c8b77bf242e" status: 200 len: 286 microversion: 2.1 time: 0.205914 Apr 20 18:31:36.736332 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1241 bytes} [Tue Apr 20 18:31:36 2021] GET /compute/v2.1/os-snapshots/edeeca01-1dcc-4661-a790-1c8b77bf242e => generated 286 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:31:36.742536 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c198c4c2-ac36-4df2-a2b5-b3fdef388f6c tempest-VolumesGetTestJSON-1040841746 tempest-VolumesGetTestJSON-1040841746-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/514aa4b3-ba0e-4c97-a00c-b9ca221876e9" status: 200 len: 352 microversion: 2.1 time: 0.439380 Apr 20 18:31:36.744103 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 9/17] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Apr 20 18:31:36 2021] GET /compute/v2.1/os-volumes/514aa4b3-ba0e-4c97-a00c-b9ca221876e9 => generated 352 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:31:37.054220 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3b068309-856c-4d0b-b6ca-c030705dcc6e tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:37.055558 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3b068309-856c-4d0b-b6ca-c030705dcc6e tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:31:37.209868 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7dd6834b-c079-465c-bca7-2f8fee8c4b41 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:37.211260 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7dd6834b-c079-465c-bca7-2f8fee8c4b41 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:31:37.247475 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7dd6834b-c079-465c-bca7-2f8fee8c4b41 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:37.248819 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7dd6834b-c079-465c-bca7-2f8fee8c4b41 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:37.250894 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7dd6834b-c079-465c-bca7-2f8fee8c4b41 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:37.253279 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7dd6834b-c079-465c-bca7-2f8fee8c4b41 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:37.307436 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3b068309-856c-4d0b-b6ca-c030705dcc6e tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:31:37.323668 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3b068309-856c-4d0b-b6ca-c030705dcc6e tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1214 microversion: 2.1 time: 0.274997 Apr 20 18:31:37.326019 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 9/18] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:31:37 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1214 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:31:37.753056 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3ebcae71-7f88-49f1-bd20-0eb78cd35041 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] Calling method '.version_select at 0x7f418eb2c6a8>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:37.764000 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7dd6834b-c079-465c-bca7-2f8fee8c4b41 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:31:37.784022 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7dd6834b-c079-465c-bca7-2f8fee8c4b41 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 200 len: 1222 microversion: 2.1 time: 0.582308 Apr 20 18:31:37.795283 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 10/19] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:31:37 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 1222 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:31:37.797882 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d763a505-8082-44d8-98de-e0471e038b81 tempest-VolumesGetTestJSON-1040841746 tempest-VolumesGetTestJSON-1040841746-project] Calling method '.version_select at 0x7f418eb4cc80>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:37.891625 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3ebcae71-7f88-49f1-bd20-0eb78cd35041 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/edeeca01-1dcc-4661-a790-1c8b77bf242e" status: 200 len: 286 microversion: 2.1 time: 0.143725 Apr 20 18:31:37.892721 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 10/20] 10.222.0.25 () {58 vars in 1241 bytes} [Tue Apr 20 18:31:37 2021] GET /compute/v2.1/os-snapshots/edeeca01-1dcc-4661-a790-1c8b77bf242e => generated 286 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:31:38.151462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d763a505-8082-44d8-98de-e0471e038b81 tempest-VolumesGetTestJSON-1040841746 tempest-VolumesGetTestJSON-1040841746-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/514aa4b3-ba0e-4c97-a00c-b9ca221876e9" status: 200 len: 352 microversion: 2.1 time: 0.364259 Apr 20 18:31:38.158530 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 11/21] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Apr 20 18:31:37 2021] GET /compute/v2.1/os-volumes/514aa4b3-ba0e-4c97-a00c-b9ca221876e9 => generated 352 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:31:38.360041 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3a585cf7-7e29-4a19-bb2e-45cc1936e98f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:38.361231 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3a585cf7-7e29-4a19-bb2e-45cc1936e98f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:31:38.410268 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3a585cf7-7e29-4a19-bb2e-45cc1936e98f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:38.422222 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3a585cf7-7e29-4a19-bb2e-45cc1936e98f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:38.423458 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3a585cf7-7e29-4a19-bb2e-45cc1936e98f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:38.424128 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3a585cf7-7e29-4a19-bb2e-45cc1936e98f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:38.772153 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3a585cf7-7e29-4a19-bb2e-45cc1936e98f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:31:38.821769 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e0784bc0-76a6-4f97-a0f5-c078902f9bd6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:38.823093 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e0784bc0-76a6-4f97-a0f5-c078902f9bd6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:31:38.828911 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3a585cf7-7e29-4a19-bb2e-45cc1936e98f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1218 microversion: 2.1 time: 0.444068 Apr 20 18:31:38.830672 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 11/22] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:31:38 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1218 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:31:38.877979 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e0784bc0-76a6-4f97-a0f5-c078902f9bd6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:38.878853 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e0784bc0-76a6-4f97-a0f5-c078902f9bd6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:38.880793 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e0784bc0-76a6-4f97-a0f5-c078902f9bd6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:38.890302 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e0784bc0-76a6-4f97-a0f5-c078902f9bd6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:38.910044 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-95151fd0-2b01-4c54-bc6d-dcffc5fa236c tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] Calling method '.version_select at 0x7f418eb4f2f0>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:39.238924 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-95151fd0-2b01-4c54-bc6d-dcffc5fa236c tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/edeeca01-1dcc-4661-a790-1c8b77bf242e" status: 200 len: 286 microversion: 2.1 time: 0.337298 Apr 20 18:31:39.242374 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 12/23] 10.222.0.25 () {58 vars in 1241 bytes} [Tue Apr 20 18:31:38 2021] GET /compute/v2.1/os-snapshots/edeeca01-1dcc-4661-a790-1c8b77bf242e => generated 286 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:31:39.255535 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-fa3556ed-88f6-4ffb-8f9b-cb93f7289bf7 tempest-VolumesGetTestJSON-1040841746 tempest-VolumesGetTestJSON-1040841746-project] Calling method '.version_select at 0x7f418e26ad90>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:39.678665 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-fa3556ed-88f6-4ffb-8f9b-cb93f7289bf7 tempest-VolumesGetTestJSON-1040841746 tempest-VolumesGetTestJSON-1040841746-project] HTTP exception thrown: Volume 514aa4b3-ba0e-4c97-a00c-b9ca221876e9 could not be found. Apr 20 18:31:39.679357 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-fa3556ed-88f6-4ffb-8f9b-cb93f7289bf7 tempest-VolumesGetTestJSON-1040841746 tempest-VolumesGetTestJSON-1040841746-project] Returning 404 to user: Volume 514aa4b3-ba0e-4c97-a00c-b9ca221876e9 could not be found. {{(pid=100593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:31:39.680280 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-fa3556ed-88f6-4ffb-8f9b-cb93f7289bf7 tempest-VolumesGetTestJSON-1040841746 tempest-VolumesGetTestJSON-1040841746-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/514aa4b3-ba0e-4c97-a00c-b9ca221876e9" status: 404 len: 109 microversion: 2.1 time: 0.436055 Apr 20 18:31:39.680875 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 13/24] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Apr 20 18:31:39 2021] GET /compute/v2.1/os-volumes/514aa4b3-ba0e-4c97-a00c-b9ca221876e9 => generated 109 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:31:39.854675 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e1d84527-3b9f-4bdb-9f99-7f203b2a0078 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:39.859342 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e1d84527-3b9f-4bdb-9f99-7f203b2a0078 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:31:39.900982 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e1d84527-3b9f-4bdb-9f99-7f203b2a0078 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:39.905885 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e1d84527-3b9f-4bdb-9f99-7f203b2a0078 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:39.907722 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e1d84527-3b9f-4bdb-9f99-7f203b2a0078 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:39.910155 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e1d84527-3b9f-4bdb-9f99-7f203b2a0078 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:39.993788 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e0784bc0-76a6-4f97-a0f5-c078902f9bd6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:31:40.008341 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e0784bc0-76a6-4f97-a0f5-c078902f9bd6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 200 len: 1222 microversion: 2.1 time: 1.207815 Apr 20 18:31:40.011650 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 12/25] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:31:38 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 1222 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:31:40.253460 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-17502ad8-6433-4c7d-9dc8-c6b8b3c52a1b tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] Calling method '.version_select at 0x7f418eb4cd90>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:40.435768 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-17502ad8-6433-4c7d-9dc8-c6b8b3c52a1b tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/edeeca01-1dcc-4661-a790-1c8b77bf242e" status: 200 len: 287 microversion: 2.1 time: 0.186256 Apr 20 18:31:40.436767 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 13/26] 10.222.0.25 () {58 vars in 1241 bytes} [Tue Apr 20 18:31:40 2021] GET /compute/v2.1/os-snapshots/edeeca01-1dcc-4661-a790-1c8b77bf242e => generated 287 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:31:40.447687 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-830da63e-234e-4982-9b34-0c5836957b05 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] Calling method '.version_select at 0x7f418e2586a8>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:40.995668 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-830da63e-234e-4982-9b34-0c5836957b05 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/edeeca01-1dcc-4661-a790-1c8b77bf242e" status: 202 len: 0 microversion: 2.1 time: 0.551509 Apr 20 18:31:40.997610 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 14/27] 10.222.0.25 () {58 vars in 1244 bytes} [Tue Apr 20 18:31:40 2021] DELETE /compute/v2.1/os-snapshots/edeeca01-1dcc-4661-a790-1c8b77bf242e => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:31:41.006509 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-40266880-7c1e-46f5-8b96-62c984b9cb76 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] Calling method '.version_select at 0x7f418e2587b8>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:41.125186 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-40266880-7c1e-46f5-8b96-62c984b9cb76 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/edeeca01-1dcc-4661-a790-1c8b77bf242e" status: 200 len: 286 microversion: 2.1 time: 0.122677 Apr 20 18:31:41.126078 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 15/28] 10.222.0.25 () {58 vars in 1241 bytes} [Tue Apr 20 18:31:41 2021] GET /compute/v2.1/os-snapshots/edeeca01-1dcc-4661-a790-1c8b77bf242e => generated 286 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:31:41.132462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-07d6fb90-4acf-4fdc-8830-9b67f7a2c3f3 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:41.132462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-07d6fb90-4acf-4fdc-8830-9b67f7a2c3f3 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:31:41.151840 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-07d6fb90-4acf-4fdc-8830-9b67f7a2c3f3 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:41.153379 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-07d6fb90-4acf-4fdc-8830-9b67f7a2c3f3 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:41.157890 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-07d6fb90-4acf-4fdc-8830-9b67f7a2c3f3 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:41.158450 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-07d6fb90-4acf-4fdc-8830-9b67f7a2c3f3 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:42.065284 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-07d6fb90-4acf-4fdc-8830-9b67f7a2c3f3 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:31:42.084896 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-07d6fb90-4acf-4fdc-8830-9b67f7a2c3f3 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 200 len: 1278 microversion: 2.1 time: 0.957669 Apr 20 18:31:42.086845 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 16/29] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:31:41 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 1278 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:31:42.142972 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-10bc278c-47ea-4a2a-850c-491ce3ef8b96 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] Calling method '.version_select at 0x7f418e268bf8>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:42.322266 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-10bc278c-47ea-4a2a-850c-491ce3ef8b96 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] HTTP exception thrown: Snapshot edeeca01-1dcc-4661-a790-1c8b77bf242e could not be found. Apr 20 18:31:42.323255 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-10bc278c-47ea-4a2a-850c-491ce3ef8b96 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] Returning 404 to user: Snapshot edeeca01-1dcc-4661-a790-1c8b77bf242e could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:31:42.324757 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-10bc278c-47ea-4a2a-850c-491ce3ef8b96 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/edeeca01-1dcc-4661-a790-1c8b77bf242e" status: 404 len: 111 microversion: 2.1 time: 0.189649 Apr 20 18:31:42.326384 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 17/30] 10.222.0.25 () {58 vars in 1241 bytes} [Tue Apr 20 18:31:42 2021] GET /compute/v2.1/os-snapshots/edeeca01-1dcc-4661-a790-1c8b77bf242e => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:31:42.338217 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-15339a74-c793-490e-af6d-19a48063b5cc tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] Calling method '.version_select at 0x7f418f290ea0>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:42.367787 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e1d84527-3b9f-4bdb-9f99-7f203b2a0078 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:31:42.407482 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e1d84527-3b9f-4bdb-9f99-7f203b2a0078 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1210 microversion: 2.1 time: 2.561150 Apr 20 18:31:42.411538 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 14/31] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:31:39 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1210 bytes in 2567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:31:42.861821 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-15339a74-c793-490e-af6d-19a48063b5cc tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/971b1614-c541-48dc-a2f9-192a89954cf7" status: 202 len: 0 microversion: 2.1 time: 0.528834 Apr 20 18:31:42.862955 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 18/32] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Apr 20 18:31:42 2021] DELETE /compute/v2.1/os-volumes/971b1614-c541-48dc-a2f9-192a89954cf7 => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:31:42.873377 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-79471b64-76cf-4ded-aad3-545436894980 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] Calling method '.version_select at 0x7f418f211d08>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:43.123835 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-47ef723c-e962-40af-88a0-9dc761c17ba2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:43.124957 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-47ef723c-e962-40af-88a0-9dc761c17ba2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:31:43.150341 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-47ef723c-e962-40af-88a0-9dc761c17ba2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:43.151735 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-47ef723c-e962-40af-88a0-9dc761c17ba2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:43.158419 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-47ef723c-e962-40af-88a0-9dc761c17ba2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:43.159279 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-47ef723c-e962-40af-88a0-9dc761c17ba2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:43.195809 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-79471b64-76cf-4ded-aad3-545436894980 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/971b1614-c541-48dc-a2f9-192a89954cf7" status: 200 len: 344 microversion: 2.1 time: 0.326487 Apr 20 18:31:43.196467 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 15/33] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Apr 20 18:31:42 2021] GET /compute/v2.1/os-volumes/971b1614-c541-48dc-a2f9-192a89954cf7 => generated 344 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:31:43.451256 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-538a994d-487a-46b2-ba5a-a09ca7cc3243 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:43.452817 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-538a994d-487a-46b2-ba5a-a09ca7cc3243 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:31:43.470048 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-538a994d-487a-46b2-ba5a-a09ca7cc3243 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:43.470915 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-538a994d-487a-46b2-ba5a-a09ca7cc3243 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:43.471988 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-538a994d-487a-46b2-ba5a-a09ca7cc3243 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:43.473137 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-538a994d-487a-46b2-ba5a-a09ca7cc3243 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:43.665123 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-47ef723c-e962-40af-88a0-9dc761c17ba2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:31:43.684572 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-47ef723c-e962-40af-88a0-9dc761c17ba2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 200 len: 1276 microversion: 2.1 time: 0.567439 Apr 20 18:31:43.694193 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 19/34] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:31:43 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 1276 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:31:44.219060 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d22d51af-3087-4d1f-bda9-b931d09703f8 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] Calling method '.version_select at 0x7f418e268d08>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:44.438992 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-538a994d-487a-46b2-ba5a-a09ca7cc3243 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:31:44.458840 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-d22d51af-3087-4d1f-bda9-b931d09703f8 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] HTTP exception thrown: Volume 971b1614-c541-48dc-a2f9-192a89954cf7 could not be found. Apr 20 18:31:44.460615 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d22d51af-3087-4d1f-bda9-b931d09703f8 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] Returning 404 to user: Volume 971b1614-c541-48dc-a2f9-192a89954cf7 could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:31:44.462422 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d22d51af-3087-4d1f-bda9-b931d09703f8 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/971b1614-c541-48dc-a2f9-192a89954cf7" status: 404 len: 109 microversion: 2.1 time: 0.252455 Apr 20 18:31:44.463593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 20/35] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Apr 20 18:31:44 2021] GET /compute/v2.1/os-volumes/971b1614-c541-48dc-a2f9-192a89954cf7 => generated 109 bytes in 255 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:31:44.503783 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c1667940-d28b-4904-8be9-b880efb0adf1 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] Calling method '.version_select at 0x7f418e289598>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:44.507419 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-538a994d-487a-46b2-ba5a-a09ca7cc3243 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1272 microversion: 2.1 time: 1.065987 Apr 20 18:31:44.523159 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 16/36] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:31:43 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1272 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:31:44.719006 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-c1667940-d28b-4904-8be9-b880efb0adf1 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] HTTP exception thrown: Volume 971b1614-c541-48dc-a2f9-192a89954cf7 could not be found. Apr 20 18:31:44.720231 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c1667940-d28b-4904-8be9-b880efb0adf1 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] Returning 404 to user: Volume 971b1614-c541-48dc-a2f9-192a89954cf7 could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:31:44.721937 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-bea6953d-1310-4bd6-a31d-5b0c5ba12af2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:44.722257 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c1667940-d28b-4904-8be9-b880efb0adf1 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/971b1614-c541-48dc-a2f9-192a89954cf7" status: 404 len: 109 microversion: 2.1 time: 0.244280 Apr 20 18:31:44.723237 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-bea6953d-1310-4bd6-a31d-5b0c5ba12af2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:31:44.726668 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 21/37] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Apr 20 18:31:44 2021] DELETE /compute/v2.1/os-volumes/971b1614-c541-48dc-a2f9-192a89954cf7 => generated 109 bytes in 247 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:31:44.786214 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-74f96765-5d6b-43bd-a0cc-590c21a51d84 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] Calling method '.version_select at 0x7f418e268d90>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:44.791100 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bea6953d-1310-4bd6-a31d-5b0c5ba12af2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:44.797766 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bea6953d-1310-4bd6-a31d-5b0c5ba12af2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:44.803938 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bea6953d-1310-4bd6-a31d-5b0c5ba12af2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:44.808037 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bea6953d-1310-4bd6-a31d-5b0c5ba12af2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:44.948575 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-74f96765-5d6b-43bd-a0cc-590c21a51d84 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] HTTP exception thrown: Volume 971b1614-c541-48dc-a2f9-192a89954cf7 could not be found. Apr 20 18:31:44.949859 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-74f96765-5d6b-43bd-a0cc-590c21a51d84 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] Returning 404 to user: Volume 971b1614-c541-48dc-a2f9-192a89954cf7 could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:31:44.951076 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-74f96765-5d6b-43bd-a0cc-590c21a51d84 tempest-VolumesSnapshotsTestJSON-1839814185 tempest-VolumesSnapshotsTestJSON-1839814185-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/971b1614-c541-48dc-a2f9-192a89954cf7" status: 404 len: 109 microversion: 2.1 time: 0.218537 Apr 20 18:31:44.951696 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 22/38] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Apr 20 18:31:44 2021] GET /compute/v2.1/os-volumes/971b1614-c541-48dc-a2f9-192a89954cf7 => generated 109 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:31:45.539428 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b06e8f7a-9212-4bde-97dd-d29639f29a14 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:45.540685 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b06e8f7a-9212-4bde-97dd-d29639f29a14 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:31:45.565603 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b06e8f7a-9212-4bde-97dd-d29639f29a14 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:45.566578 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b06e8f7a-9212-4bde-97dd-d29639f29a14 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:45.568098 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b06e8f7a-9212-4bde-97dd-d29639f29a14 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:45.576421 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b06e8f7a-9212-4bde-97dd-d29639f29a14 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:46.380365 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b06e8f7a-9212-4bde-97dd-d29639f29a14 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:31:46.425960 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b06e8f7a-9212-4bde-97dd-d29639f29a14 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1272 microversion: 2.1 time: 0.890475 Apr 20 18:31:46.435511 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 23/39] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:31:45 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1272 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:31:47.461265 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-962f12c0-8cd0-4886-aec9-9eb24c0c1332 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:47.468202 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-962f12c0-8cd0-4886-aec9-9eb24c0c1332 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:31:47.506378 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-962f12c0-8cd0-4886-aec9-9eb24c0c1332 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:47.513194 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-962f12c0-8cd0-4886-aec9-9eb24c0c1332 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:47.515106 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-962f12c0-8cd0-4886-aec9-9eb24c0c1332 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:47.518110 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-962f12c0-8cd0-4886-aec9-9eb24c0c1332 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:50.189486 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-bea6953d-1310-4bd6-a31d-5b0c5ba12af2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:31:50.210820 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-bea6953d-1310-4bd6-a31d-5b0c5ba12af2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 200 len: 1318 microversion: 2.1 time: 5.501955 Apr 20 18:31:50.213810 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 17/40] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:31:44 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 1318 bytes in 5509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:31:50.782387 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e247653e-b39c-40f0-be80-7cb9d339cac7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'create', calling method: .version_select at 0x7f418e2e4620>, body: {"keypair": {"name": "tempest-keypair-1725491342"}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:31:51.155132 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-e247653e-b39c-40f0-be80-7cb9d339cac7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Getting quotas for project 379c1b40340b46408792cb7d852bbba7. Resources: {'key_pairs'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:31:51.190291 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-e247653e-b39c-40f0-be80-7cb9d339cac7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Getting quotas for user 61a26e5925ce4f50ab72f8d18670edd6 and project 379c1b40340b46408792cb7d852bbba7. Resources: {'key_pairs'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:31:51.782632 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-e247653e-b39c-40f0-be80-7cb9d339cac7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Getting quotas for project 379c1b40340b46408792cb7d852bbba7. Resources: {'key_pairs'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:31:51.798748 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-e247653e-b39c-40f0-be80-7cb9d339cac7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Getting quotas for user 61a26e5925ce4f50ab72f8d18670edd6 and project 379c1b40340b46408792cb7d852bbba7. Resources: {'key_pairs'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:31:51.828162 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e247653e-b39c-40f0-be80-7cb9d339cac7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.612073 Apr 20 18:31:51.832381 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 18/41] 10.222.0.25 () {60 vars in 1148 bytes} [Tue Apr 20 18:31:50 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:31:51.847836 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-27932403-e632-4d6f-bd78-43c441a70e27 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:51.857425 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-27932403-e632-4d6f-bd78-43c441a70e27 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:31:51.873764 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-27932403-e632-4d6f-bd78-43c441a70e27 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:51.877910 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-27932403-e632-4d6f-bd78-43c441a70e27 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:51.878980 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-27932403-e632-4d6f-bd78-43c441a70e27 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:51.882493 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-27932403-e632-4d6f-bd78-43c441a70e27 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:52.516027 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-962f12c0-8cd0-4886-aec9-9eb24c0c1332 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:31:52.591230 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-962f12c0-8cd0-4886-aec9-9eb24c0c1332 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1314 microversion: 2.1 time: 5.138956 Apr 20 18:31:52.592377 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 24/42] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:31:47 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1314 bytes in 5143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:31:53.614705 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-780aae3d-c96c-4106-8bcc-f78451d6fa01 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:53.615371 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-780aae3d-c96c-4106-8bcc-f78451d6fa01 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:31:53.645068 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-780aae3d-c96c-4106-8bcc-f78451d6fa01 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:53.645975 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-780aae3d-c96c-4106-8bcc-f78451d6fa01 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:53.647091 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-780aae3d-c96c-4106-8bcc-f78451d6fa01 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:53.647974 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-780aae3d-c96c-4106-8bcc-f78451d6fa01 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:55.204916 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-780aae3d-c96c-4106-8bcc-f78451d6fa01 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:31:55.229630 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-780aae3d-c96c-4106-8bcc-f78451d6fa01 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1314 microversion: 2.1 time: 1.618890 Apr 20 18:31:55.231101 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 25/43] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:31:53 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1314 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:31:56.255955 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e201b2d1-2525-4c5c-9a00-205e3bc98417 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:56.257512 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e201b2d1-2525-4c5c-9a00-205e3bc98417 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:31:56.276276 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e201b2d1-2525-4c5c-9a00-205e3bc98417 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:56.282207 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e201b2d1-2525-4c5c-9a00-205e3bc98417 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:56.283675 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e201b2d1-2525-4c5c-9a00-205e3bc98417 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:56.284365 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e201b2d1-2525-4c5c-9a00-205e3bc98417 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:57.762983 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e201b2d1-2525-4c5c-9a00-205e3bc98417 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:31:57.782051 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e201b2d1-2525-4c5c-9a00-205e3bc98417 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1314 microversion: 2.1 time: 1.530520 Apr 20 18:31:57.792000 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 26/44] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:31:56 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1314 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:31:57.986902 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-27932403-e632-4d6f-bd78-43c441a70e27 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:31:58.002375 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-27932403-e632-4d6f-bd78-43c441a70e27 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 200 len: 1318 microversion: 2.1 time: 6.159497 Apr 20 18:31:58.003582 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 19/45] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:31:51 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 1318 bytes in 6163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:31:58.291473 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-c8634fd3-15f4-4a4c-9537-3e8b3833ec93 req-13605c9d-395b-4003-8179-9881d5122d2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ba03ca2-62f0-4f02-b42f-5e99b7126063", "tag": "fc49b83a-1530-42ad-b886-8026ee93c006"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:31:58.310273 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:31:58.310273 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:31:58.346190 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-c8634fd3-15f4-4a4c-9537-3e8b3833ec93 req-13605c9d-395b-4003-8179-9881d5122d2c service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:58.348551 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-c8634fd3-15f4-4a4c-9537-3e8b3833ec93 req-13605c9d-395b-4003-8179-9881d5122d2c service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:58.404540 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-c8634fd3-15f4-4a4c-9537-3e8b3833ec93 req-13605c9d-395b-4003-8179-9881d5122d2c service nova] Creating event network-changed:fc49b83a-1530-42ad-b886-8026ee93c006 for instance 2ba03ca2-62f0-4f02-b42f-5e99b7126063 on hv-cinder-78693 Apr 20 18:31:58.410156 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-c8634fd3-15f4-4a4c-9537-3e8b3833ec93 req-13605c9d-395b-4003-8179-9881d5122d2c service nova] Acquired lock "compute-rpcapi-router" {{(pid=100592) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 20 18:31:58.413843 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-71d06306-a2e9-4092-8766-bfad56382d1f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:58.415062 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-71d06306-a2e9-4092-8766-bfad56382d1f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:58.416884 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-71d06306-a2e9-4092-8766-bfad56382d1f None None] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:58.418086 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-71d06306-a2e9-4092-8766-bfad56382d1f None None] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:58.440030 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.compute.rpcapi [None req-71d06306-a2e9-4092-8766-bfad56382d1f None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 20 18:31:58.445249 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-71d06306-a2e9-4092-8766-bfad56382d1f None None] Releasing lock "compute-rpcapi-router" {{(pid=100592) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 20 18:31:58.545881 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-71d06306-a2e9-4092-8766-bfad56382d1f None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.750528 Apr 20 18:31:58.547559 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 27/46] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:31:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:31:58.817040 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f6bb0d0c-339f-4511-a71c-b8e3492753a8 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:58.825474 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f6bb0d0c-339f-4511-a71c-b8e3492753a8 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:31:58.849309 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f6bb0d0c-339f-4511-a71c-b8e3492753a8 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:58.851477 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f6bb0d0c-339f-4511-a71c-b8e3492753a8 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:58.852435 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f6bb0d0c-339f-4511-a71c-b8e3492753a8 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:58.852920 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f6bb0d0c-339f-4511-a71c-b8e3492753a8 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:59.040889 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5a4a5d19-72dc-44ab-b7d2-6ea460132adf tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:31:59.045206 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5a4a5d19-72dc-44ab-b7d2-6ea460132adf tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:31:59.083059 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a4a5d19-72dc-44ab-b7d2-6ea460132adf tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:59.093582 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a4a5d19-72dc-44ab-b7d2-6ea460132adf tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:31:59.095953 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a4a5d19-72dc-44ab-b7d2-6ea460132adf tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:31:59.098021 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a4a5d19-72dc-44ab-b7d2-6ea460132adf tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:00.718382 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5a4a5d19-72dc-44ab-b7d2-6ea460132adf tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:00.731491 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5a4a5d19-72dc-44ab-b7d2-6ea460132adf tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 200 len: 1318 microversion: 2.1 time: 1.710166 Apr 20 18:32:00.736352 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 28/47] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:31:59 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 1318 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:01.038892 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-46ccd4f4-cf1b-4d59-a1fc-b1dfe75e9060 req-47f97827-de9e-4e25-b137-7bad3963ac09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52555464-f186-4c7e-9183-b2f64ebe3c70", "tag": "86f572d7-1e31-48f3-871a-dda81cfd9335"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:01.038892 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:32:01.038892 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:32:01.044365 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-46ccd4f4-cf1b-4d59-a1fc-b1dfe75e9060 req-47f97827-de9e-4e25-b137-7bad3963ac09 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:01.045085 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-46ccd4f4-cf1b-4d59-a1fc-b1dfe75e9060 req-47f97827-de9e-4e25-b137-7bad3963ac09 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:01.072579 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-46ccd4f4-cf1b-4d59-a1fc-b1dfe75e9060 req-47f97827-de9e-4e25-b137-7bad3963ac09 service nova] Creating event network-changed:86f572d7-1e31-48f3-871a-dda81cfd9335 for instance 52555464-f186-4c7e-9183-b2f64ebe3c70 on hv-cinder-78693 Apr 20 18:32:01.080342 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-46ccd4f4-cf1b-4d59-a1fc-b1dfe75e9060 req-47f97827-de9e-4e25-b137-7bad3963ac09 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052104 Apr 20 18:32:01.081760 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 29/48] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:32:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:32:01.777376 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-94c6c6f6-2f01-40fe-877a-5e1ce91416ad tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:01.789887 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-94c6c6f6-2f01-40fe-877a-5e1ce91416ad tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:01.835372 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-94c6c6f6-2f01-40fe-877a-5e1ce91416ad tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:01.837827 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-94c6c6f6-2f01-40fe-877a-5e1ce91416ad tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:01.840114 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-94c6c6f6-2f01-40fe-877a-5e1ce91416ad tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:01.844936 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-94c6c6f6-2f01-40fe-877a-5e1ce91416ad tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:02.093365 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f6bb0d0c-339f-4511-a71c-b8e3492753a8 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:02.166385 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f6bb0d0c-339f-4511-a71c-b8e3492753a8 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1314 microversion: 2.1 time: 3.352511 Apr 20 18:32:02.169774 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 20/49] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:31:58 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1314 bytes in 3358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:03.219363 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8929335f-e835-4354-bc49-c74d22da549f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:03.242318 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8929335f-e835-4354-bc49-c74d22da549f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:03.305471 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8929335f-e835-4354-bc49-c74d22da549f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:03.307320 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8929335f-e835-4354-bc49-c74d22da549f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:03.311327 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8929335f-e835-4354-bc49-c74d22da549f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:03.312533 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8929335f-e835-4354-bc49-c74d22da549f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:04.208154 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8929335f-e835-4354-bc49-c74d22da549f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:04.280743 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8929335f-e835-4354-bc49-c74d22da549f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1314 microversion: 2.1 time: 1.084494 Apr 20 18:32:04.284306 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 21/50] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:03 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1314 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:04.297088 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-94c6c6f6-2f01-40fe-877a-5e1ce91416ad tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:04.310209 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-94c6c6f6-2f01-40fe-877a-5e1ce91416ad tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 200 len: 1318 microversion: 2.1 time: 2.548809 Apr 20 18:32:04.313182 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 30/51] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:01 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 1318 bytes in 2555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:04.916243 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d7980d5c-ea06-49c6-b358-81f79bcd8e37 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'create', calling method: .version_select at 0x7f418e278ea0>, body: {"keypair": {"name": "tempest-keypair-1572287718"}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:04.992065 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-d7980d5c-ea06-49c6-b358-81f79bcd8e37 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Getting quotas for project 39f3f26f55524d2d89d7c9cd7f9548f1. Resources: {'key_pairs'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:32:04.997420 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7664512a-9fd3-4e12-b378-8e28f9d9e54a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-462000944", "imageRef": "ba8326d8-5d1b-42a2-a65e-f1108a025e30", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb994278-e70a-428c-a39c-4fb273cb636f"}]}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:04.997877 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-d7980d5c-ea06-49c6-b358-81f79bcd8e37 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Getting quotas for user 6bc02f4b196a44a5abb1843ae0b099bf and project 39f3f26f55524d2d89d7c9cd7f9548f1. Resources: {'key_pairs'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:32:05.215529 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.network.neutron [None req-7664512a-9fd3-4e12-b378-8e28f9d9e54a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] validate_networks() for [('bb994278-e70a-428c-a39c-4fb273cb636f', None, None, None)] {{(pid=100592) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:32:05.635799 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-d7980d5c-ea06-49c6-b358-81f79bcd8e37 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Getting quotas for project 39f3f26f55524d2d89d7c9cd7f9548f1. Resources: {'key_pairs'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:32:05.640987 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-d7980d5c-ea06-49c6-b358-81f79bcd8e37 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Getting quotas for user 6bc02f4b196a44a5abb1843ae0b099bf and project 39f3f26f55524d2d89d7c9cd7f9548f1. Resources: {'key_pairs'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:32:05.672275 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d7980d5c-ea06-49c6-b358-81f79bcd8e37 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.266357 Apr 20 18:32:05.672963 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 22/52] 10.222.0.25 () {62 vars in 1189 bytes} [Tue Apr 20 18:32:04 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1268 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 20 18:32:05.684037 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d6923223-219f-4e80-b38f-d9b1094a03f8 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:05.684729 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d6923223-219f-4e80-b38f-d9b1094a03f8 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:05.711228 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d6923223-219f-4e80-b38f-d9b1094a03f8 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:05.711767 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d6923223-219f-4e80-b38f-d9b1094a03f8 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:05.712662 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d6923223-219f-4e80-b38f-d9b1094a03f8 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:05.713195 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d6923223-219f-4e80-b38f-d9b1094a03f8 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:06.300817 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d6923223-219f-4e80-b38f-d9b1094a03f8 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:06.320166 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d6923223-219f-4e80-b38f-d9b1094a03f8 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1314 microversion: 2.1 time: 0.645917 Apr 20 18:32:06.325654 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 23/53] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:05 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:06.331024 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6bc8b398-5964-46a7-933f-5ef132ad111f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:06.331676 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6bc8b398-5964-46a7-933f-5ef132ad111f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:06.399185 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6bc8b398-5964-46a7-933f-5ef132ad111f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:06.399705 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6bc8b398-5964-46a7-933f-5ef132ad111f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:06.400594 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6bc8b398-5964-46a7-933f-5ef132ad111f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:06.423062 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6bc8b398-5964-46a7-933f-5ef132ad111f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:07.342349 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-7664512a-9fd3-4e12-b378-8e28f9d9e54a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Flavor limits 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:32:07.344101 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-7664512a-9fd3-4e12-b378-8e28f9d9e54a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Image limits 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:32:07.344993 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-7664512a-9fd3-4e12-b378-8e28f9d9e54a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Flavor pref 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:32:07.345751 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-7664512a-9fd3-4e12-b378-8e28f9d9e54a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Image pref 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:32:07.346438 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-7664512a-9fd3-4e12-b378-8e28f9d9e54a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:32:07.377798 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7664512a-9fd3-4e12-b378-8e28f9d9e54a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:07.383249 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7664512a-9fd3-4e12-b378-8e28f9d9e54a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:07.389017 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7664512a-9fd3-4e12-b378-8e28f9d9e54a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:07.389892 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7664512a-9fd3-4e12-b378-8e28f9d9e54a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:07.463581 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-7664512a-9fd3-4e12-b378-8e28f9d9e54a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Getting quotas for project 604c8aa9b3d9478692cb6362f90fb56b. Resources: {'instances', 'ram', 'cores'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:32:07.477925 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-7664512a-9fd3-4e12-b378-8e28f9d9e54a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Getting quotas for user 721d0f42e9ad4c15a58a04b94d319c5c and project 604c8aa9b3d9478692cb6362f90fb56b. Resources: {'instances', 'ram', 'cores'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:32:07.517321 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7664512a-9fd3-4e12-b378-8e28f9d9e54a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Going to run 1 instances... {{(pid=100592) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:32:07.520632 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7664512a-9fd3-4e12-b378-8e28f9d9e54a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba8326d8-5d1b-42a2-a65e-f1108a025e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100592) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:32:07.632805 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7664512a-9fd3-4e12-b378-8e28f9d9e54a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.058024 Apr 20 18:32:07.639415 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 31/54] 10.222.0.25 () {60 vars in 1137 bytes} [Tue Apr 20 18:32:04 2021] POST /compute/v2.1/servers => generated 383 bytes in 3066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:32:07.644574 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b64a6168-aa96-4fbe-b999-b0543039e3be tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:07.645251 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b64a6168-aa96-4fbe-b999-b0543039e3be tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:07.657472 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b64a6168-aa96-4fbe-b999-b0543039e3be tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:07.664858 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b64a6168-aa96-4fbe-b999-b0543039e3be tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:07.666275 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b64a6168-aa96-4fbe-b999-b0543039e3be tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:07.666467 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6bc8b398-5964-46a7-933f-5ef132ad111f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:07.667127 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b64a6168-aa96-4fbe-b999-b0543039e3be tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:07.701727 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6bc8b398-5964-46a7-933f-5ef132ad111f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 200 len: 1318 microversion: 2.1 time: 1.374612 Apr 20 18:32:07.702301 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 24/55] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:06 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 1318 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:07.721255 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-58c5c04e-5e66-4359-8a67-6eb36361ea46 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:07.721961 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-58c5c04e-5e66-4359-8a67-6eb36361ea46 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:08.065171 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-58c5c04e-5e66-4359-8a67-6eb36361ea46 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:08.088994 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-58c5c04e-5e66-4359-8a67-6eb36361ea46 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1221 microversion: 2.1 time: 0.385501 Apr 20 18:32:08.095273 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 25/56] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:07 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1221 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:08.449731 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-79dbc010-94d7-42a4-9623-8dff7f9e3dcb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-995421103", "imageRef": "ba8326d8-5d1b-42a2-a65e-f1108a025e30", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb994278-e70a-428c-a39c-4fb273cb636f"}]}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:08.578524 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.network.neutron [None req-79dbc010-94d7-42a4-9623-8dff7f9e3dcb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] validate_networks() for [('bb994278-e70a-428c-a39c-4fb273cb636f', None, None, None)] {{(pid=100593) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:32:09.047809 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b64a6168-aa96-4fbe-b999-b0543039e3be tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:09.058579 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b64a6168-aa96-4fbe-b999-b0543039e3be tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1314 microversion: 2.1 time: 1.417314 Apr 20 18:32:09.059393 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 32/57] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:07 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1314 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:09.075321 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c1a11fb2-52a7-4b26-a189-85bd540c3bd7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-378112461", "imageRef": "ba8326d8-5d1b-42a2-a65e-f1108a025e30", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d598126-4968-4ab9-864c-ac1f0ffd6a08"}], "security_groups": [{"name": "tempest-securitygroup--431462095"}], "key_name": "tempest-keypair-1725491342", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:09.507120 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.network.neutron [None req-c1a11fb2-52a7-4b26-a189-85bd540c3bd7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] validate_networks() for [('6d598126-4968-4ab9-864c-ac1f0ffd6a08', None, None, None)] {{(pid=100592) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:32:10.823847 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-79dbc010-94d7-42a4-9623-8dff7f9e3dcb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Flavor limits 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:32:10.825528 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-79dbc010-94d7-42a4-9623-8dff7f9e3dcb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Image limits 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:32:10.826624 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-79dbc010-94d7-42a4-9623-8dff7f9e3dcb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Flavor pref 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:32:10.827354 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-79dbc010-94d7-42a4-9623-8dff7f9e3dcb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Image pref 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:32:10.828254 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-79dbc010-94d7-42a4-9623-8dff7f9e3dcb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:32:10.847945 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79dbc010-94d7-42a4-9623-8dff7f9e3dcb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:10.849546 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79dbc010-94d7-42a4-9623-8dff7f9e3dcb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:10.850716 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79dbc010-94d7-42a4-9623-8dff7f9e3dcb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:10.853610 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79dbc010-94d7-42a4-9623-8dff7f9e3dcb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:10.907591 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-79dbc010-94d7-42a4-9623-8dff7f9e3dcb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Getting quotas for project 604c8aa9b3d9478692cb6362f90fb56b. Resources: {'instances', 'ram', 'cores'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:32:10.923094 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-79dbc010-94d7-42a4-9623-8dff7f9e3dcb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Getting quotas for user 721d0f42e9ad4c15a58a04b94d319c5c and project 604c8aa9b3d9478692cb6362f90fb56b. Resources: {'instances', 'ram', 'cores'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:32:10.937126 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-79dbc010-94d7-42a4-9623-8dff7f9e3dcb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Going to run 1 instances... {{(pid=100593) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:32:10.940476 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-79dbc010-94d7-42a4-9623-8dff7f9e3dcb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba8326d8-5d1b-42a2-a65e-f1108a025e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:32:11.047801 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-79dbc010-94d7-42a4-9623-8dff7f9e3dcb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.603408 Apr 20 18:32:11.056787 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 26/58] 10.222.0.25 () {60 vars in 1137 bytes} [Tue Apr 20 18:32:08 2021] POST /compute/v2.1/servers => generated 383 bytes in 2611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:32:11.108077 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8f836f88-22df-42a9-b366-27992ab46466 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:11.116876 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8f836f88-22df-42a9-b366-27992ab46466 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:11.146630 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8f836f88-22df-42a9-b366-27992ab46466 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:11.147809 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8f836f88-22df-42a9-b366-27992ab46466 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:11.150310 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8f836f88-22df-42a9-b366-27992ab46466 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:11.154087 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8f836f88-22df-42a9-b366-27992ab46466 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:12.174081 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8f836f88-22df-42a9-b366-27992ab46466 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:12.189802 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8f836f88-22df-42a9-b366-27992ab46466 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 200 len: 1318 microversion: 2.1 time: 1.126085 Apr 20 18:32:12.195302 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 27/59] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:11 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 1318 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:12.205194 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f32a52f0-3713-4a85-b862-cf3eea67fd72 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:12.206147 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f32a52f0-3713-4a85-b862-cf3eea67fd72 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:12.227297 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f32a52f0-3713-4a85-b862-cf3eea67fd72 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:12.228040 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f32a52f0-3713-4a85-b862-cf3eea67fd72 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:12.229078 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f32a52f0-3713-4a85-b862-cf3eea67fd72 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:12.230461 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f32a52f0-3713-4a85-b862-cf3eea67fd72 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:12.596539 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-c1a11fb2-52a7-4b26-a189-85bd540c3bd7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Flavor limits 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:32:12.597017 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-c1a11fb2-52a7-4b26-a189-85bd540c3bd7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Image limits 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:32:12.597626 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-c1a11fb2-52a7-4b26-a189-85bd540c3bd7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Flavor pref 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:32:12.598086 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-c1a11fb2-52a7-4b26-a189-85bd540c3bd7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Image pref 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:32:12.598549 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-c1a11fb2-52a7-4b26-a189-85bd540c3bd7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:32:12.612072 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c1a11fb2-52a7-4b26-a189-85bd540c3bd7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:12.612860 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c1a11fb2-52a7-4b26-a189-85bd540c3bd7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:12.614607 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c1a11fb2-52a7-4b26-a189-85bd540c3bd7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:12.615315 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c1a11fb2-52a7-4b26-a189-85bd540c3bd7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:12.636266 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-c1a11fb2-52a7-4b26-a189-85bd540c3bd7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Getting quotas for project 379c1b40340b46408792cb7d852bbba7. Resources: {'instances', 'ram', 'cores'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:32:12.642084 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-c1a11fb2-52a7-4b26-a189-85bd540c3bd7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Getting quotas for user 61a26e5925ce4f50ab72f8d18670edd6 and project 379c1b40340b46408792cb7d852bbba7. Resources: {'instances', 'ram', 'cores'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:32:12.654306 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c1a11fb2-52a7-4b26-a189-85bd540c3bd7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Going to run 1 instances... {{(pid=100592) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:32:12.657279 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c1a11fb2-52a7-4b26-a189-85bd540c3bd7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba8326d8-5d1b-42a2-a65e-f1108a025e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100592) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:32:12.739242 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c1a11fb2-52a7-4b26-a189-85bd540c3bd7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.668826 Apr 20 18:32:12.741730 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 33/60] 10.222.0.25 () {60 vars in 1137 bytes} [Tue Apr 20 18:32:09 2021] POST /compute/v2.1/servers => generated 401 bytes in 3682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:32:12.752025 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-19c0e5f9-f4a0-4da9-8eb8-06a392fb692e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:12.762338 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-19c0e5f9-f4a0-4da9-8eb8-06a392fb692e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:12.789605 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-19c0e5f9-f4a0-4da9-8eb8-06a392fb692e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:12.800638 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-19c0e5f9-f4a0-4da9-8eb8-06a392fb692e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:12.805251 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-19c0e5f9-f4a0-4da9-8eb8-06a392fb692e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:12.814073 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-19c0e5f9-f4a0-4da9-8eb8-06a392fb692e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:13.940879 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-19c0e5f9-f4a0-4da9-8eb8-06a392fb692e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:13.958967 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-19c0e5f9-f4a0-4da9-8eb8-06a392fb692e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1281 microversion: 2.1 time: 1.215872 Apr 20 18:32:13.959640 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 34/61] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:12 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1281 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:13.973283 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-cd394fb2-391f-4474-98fe-3fb28805b563 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:13.974018 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-cd394fb2-391f-4474-98fe-3fb28805b563 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:13.988817 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cd394fb2-391f-4474-98fe-3fb28805b563 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:13.989330 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cd394fb2-391f-4474-98fe-3fb28805b563 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:13.990229 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cd394fb2-391f-4474-98fe-3fb28805b563 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:13.990707 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cd394fb2-391f-4474-98fe-3fb28805b563 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:14.289903 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-cd394fb2-391f-4474-98fe-3fb28805b563 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:14.301808 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f32a52f0-3713-4a85-b862-cf3eea67fd72 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:14.302210 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-cd394fb2-391f-4474-98fe-3fb28805b563 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1233 microversion: 2.1 time: 0.341420 Apr 20 18:32:14.302851 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 35/62] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:13 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1233 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:14.333156 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f32a52f0-3713-4a85-b862-cf3eea67fd72 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1314 microversion: 2.1 time: 2.136441 Apr 20 18:32:14.339888 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 28/63] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:12 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1314 bytes in 2144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:14.349542 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8d21734d-dd59-4069-962f-16dd0785c96b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:14.351710 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8d21734d-dd59-4069-962f-16dd0785c96b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:14.377292 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8d21734d-dd59-4069-962f-16dd0785c96b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:14.378926 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8d21734d-dd59-4069-962f-16dd0785c96b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:14.381153 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8d21734d-dd59-4069-962f-16dd0785c96b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:14.383786 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8d21734d-dd59-4069-962f-16dd0785c96b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:14.627115 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-cdc76d55-224b-446b-a8ff-fa851d33e1e4 req-aa031c51-bc9a-4aa9-aa19-c36b7a09202b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52555464-f186-4c7e-9183-b2f64ebe3c70", "name": "network-vif-plugged", "status": "completed", "tag": "86f572d7-1e31-48f3-871a-dda81cfd9335"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:14.629048 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:32:14.629048 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:32:14.660085 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-cdc76d55-224b-446b-a8ff-fa851d33e1e4 req-aa031c51-bc9a-4aa9-aa19-c36b7a09202b service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:14.660589 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-cdc76d55-224b-446b-a8ff-fa851d33e1e4 req-aa031c51-bc9a-4aa9-aa19-c36b7a09202b service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:14.727103 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-cdc76d55-224b-446b-a8ff-fa851d33e1e4 req-aa031c51-bc9a-4aa9-aa19-c36b7a09202b service nova] Creating event network-vif-plugged:86f572d7-1e31-48f3-871a-dda81cfd9335 for instance 52555464-f186-4c7e-9183-b2f64ebe3c70 on hv-cinder-78693 Apr 20 18:32:14.742635 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-cdc76d55-224b-446b-a8ff-fa851d33e1e4 req-aa031c51-bc9a-4aa9-aa19-c36b7a09202b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.430894 Apr 20 18:32:14.743672 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 36/64] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:32:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:32:14.979055 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-614093d8-7968-4d3f-b1fa-3565363a294c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:14.980403 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-614093d8-7968-4d3f-b1fa-3565363a294c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:15.003306 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-614093d8-7968-4d3f-b1fa-3565363a294c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:15.003826 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-614093d8-7968-4d3f-b1fa-3565363a294c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:15.004894 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-614093d8-7968-4d3f-b1fa-3565363a294c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:15.005435 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-614093d8-7968-4d3f-b1fa-3565363a294c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:15.389671 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-614093d8-7968-4d3f-b1fa-3565363a294c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:15.404426 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-614093d8-7968-4d3f-b1fa-3565363a294c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1279 microversion: 2.1 time: 0.430264 Apr 20 18:32:15.405089 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 37/65] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:14 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1279 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:15.428401 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-a088a135-0d4b-4c95-a474-1e0328f63618 req-ebcc2705-3e67-4311-aad5-d3c3b503386e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d", "tag": "4d8858cf-3006-4b33-ae23-0eeb01318afd"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:15.430905 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:32:15.430905 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:32:15.443735 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-a088a135-0d4b-4c95-a474-1e0328f63618 req-ebcc2705-3e67-4311-aad5-d3c3b503386e service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:15.444394 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-a088a135-0d4b-4c95-a474-1e0328f63618 req-ebcc2705-3e67-4311-aad5-d3c3b503386e service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:15.469529 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-a088a135-0d4b-4c95-a474-1e0328f63618 req-ebcc2705-3e67-4311-aad5-d3c3b503386e service nova] Creating event network-changed:4d8858cf-3006-4b33-ae23-0eeb01318afd for instance aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d on hv-cinder-78693 Apr 20 18:32:15.475671 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-a088a135-0d4b-4c95-a474-1e0328f63618 req-ebcc2705-3e67-4311-aad5-d3c3b503386e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069320 Apr 20 18:32:15.476700 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 38/66] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:32:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:32:15.485214 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4f52d26b-fd04-4a81-b4b8-5f8c4db2c38c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:15.486243 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4f52d26b-fd04-4a81-b4b8-5f8c4db2c38c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:15.504304 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4f52d26b-fd04-4a81-b4b8-5f8c4db2c38c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:15.505161 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4f52d26b-fd04-4a81-b4b8-5f8c4db2c38c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:15.506198 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4f52d26b-fd04-4a81-b4b8-5f8c4db2c38c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:15.506839 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4f52d26b-fd04-4a81-b4b8-5f8c4db2c38c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:15.789520 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4f52d26b-fd04-4a81-b4b8-5f8c4db2c38c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:15.835199 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4f52d26b-fd04-4a81-b4b8-5f8c4db2c38c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1295 microversion: 2.1 time: 0.353826 Apr 20 18:32:15.844977 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 39/67] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:15 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1295 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:15.850394 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e9d80d68-52e4-4039-a127-143f645c17bf tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:15.851055 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e9d80d68-52e4-4039-a127-143f645c17bf tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:15.861555 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e9d80d68-52e4-4039-a127-143f645c17bf tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:15.861789 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e9d80d68-52e4-4039-a127-143f645c17bf tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:15.862769 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e9d80d68-52e4-4039-a127-143f645c17bf tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:15.863301 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e9d80d68-52e4-4039-a127-143f645c17bf tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:16.020071 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8d21734d-dd59-4069-962f-16dd0785c96b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:16.033908 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8d21734d-dd59-4069-962f-16dd0785c96b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 200 len: 1318 microversion: 2.1 time: 1.691334 Apr 20 18:32:16.035199 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 29/68] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:14 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 1318 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:16.424852 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-20f1bfce-9a79-4f5e-b3ec-8ac644c74aff tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:16.426070 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-20f1bfce-9a79-4f5e-b3ec-8ac644c74aff tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:16.437727 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-20f1bfce-9a79-4f5e-b3ec-8ac644c74aff tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:16.439023 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-20f1bfce-9a79-4f5e-b3ec-8ac644c74aff tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:16.440145 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-20f1bfce-9a79-4f5e-b3ec-8ac644c74aff tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:16.440989 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-20f1bfce-9a79-4f5e-b3ec-8ac644c74aff tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:16.714115 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-20f1bfce-9a79-4f5e-b3ec-8ac644c74aff tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:16.725017 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-20f1bfce-9a79-4f5e-b3ec-8ac644c74aff tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1279 microversion: 2.1 time: 0.305058 Apr 20 18:32:16.726730 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 30/69] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:16 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1279 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:16.765143 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-97ee6811-a61b-497a-88d3-05907c1ef7b6 req-546a594e-c489-47a8-b6ea-a356482ce1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba03ca2-62f0-4f02-b42f-5e99b7126063", "name": "network-vif-plugged", "status": "completed", "tag": "fc49b83a-1530-42ad-b886-8026ee93c006"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:16.768743 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:32:16.768743 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:32:16.781226 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-97ee6811-a61b-497a-88d3-05907c1ef7b6 req-546a594e-c489-47a8-b6ea-a356482ce1e3 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:16.782265 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-97ee6811-a61b-497a-88d3-05907c1ef7b6 req-546a594e-c489-47a8-b6ea-a356482ce1e3 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:16.807109 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-97ee6811-a61b-497a-88d3-05907c1ef7b6 req-546a594e-c489-47a8-b6ea-a356482ce1e3 service nova] Creating event network-vif-plugged:fc49b83a-1530-42ad-b886-8026ee93c006 for instance 2ba03ca2-62f0-4f02-b42f-5e99b7126063 on hv-cinder-78693 Apr 20 18:32:16.808870 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-97ee6811-a61b-497a-88d3-05907c1ef7b6 req-546a594e-c489-47a8-b6ea-a356482ce1e3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=100593) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 20 18:32:16.810393 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3308f47d-b5f2-4625-96f5-6f47b0ae0947 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:16.811095 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3308f47d-b5f2-4625-96f5-6f47b0ae0947 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:16.813032 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3308f47d-b5f2-4625-96f5-6f47b0ae0947 None None] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:16.814212 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3308f47d-b5f2-4625-96f5-6f47b0ae0947 None None] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:16.829689 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.compute.rpcapi [None req-3308f47d-b5f2-4625-96f5-6f47b0ae0947 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 20 18:32:16.831514 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3308f47d-b5f2-4625-96f5-6f47b0ae0947 None None] Releasing lock "compute-rpcapi-router" {{(pid=100593) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 20 18:32:16.864928 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3308f47d-b5f2-4625-96f5-6f47b0ae0947 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103794 Apr 20 18:32:16.865992 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 31/70] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:32:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:32:16.871668 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-378a5bce-b921-41aa-9677-fafc1a9160c9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:16.872798 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-378a5bce-b921-41aa-9677-fafc1a9160c9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:16.881723 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-378a5bce-b921-41aa-9677-fafc1a9160c9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:16.882499 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-378a5bce-b921-41aa-9677-fafc1a9160c9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:16.883610 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-378a5bce-b921-41aa-9677-fafc1a9160c9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:16.884538 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-378a5bce-b921-41aa-9677-fafc1a9160c9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:17.082657 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e9d80d68-52e4-4039-a127-143f645c17bf tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:17.110821 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e9d80d68-52e4-4039-a127-143f645c17bf tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1314 microversion: 2.1 time: 1.264255 Apr 20 18:32:17.115091 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 40/71] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:15 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1314 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:17.160032 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a2ba7374-eae0-4482-b4c8-5b891d460907 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:17.160897 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a2ba7374-eae0-4482-b4c8-5b891d460907 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:17.186658 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a2ba7374-eae0-4482-b4c8-5b891d460907 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:17.186658 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a2ba7374-eae0-4482-b4c8-5b891d460907 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:17.186658 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a2ba7374-eae0-4482-b4c8-5b891d460907 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:17.186658 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a2ba7374-eae0-4482-b4c8-5b891d460907 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:17.538808 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-378a5bce-b921-41aa-9677-fafc1a9160c9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:17.555132 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-378a5bce-b921-41aa-9677-fafc1a9160c9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1295 microversion: 2.1 time: 0.687287 Apr 20 18:32:17.556436 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 32/72] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:16 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1295 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:17.744862 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3c0aabc5-9617-4e35-9e8c-fb269449c8fe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:17.745775 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3c0aabc5-9617-4e35-9e8c-fb269449c8fe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:17.766524 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c0aabc5-9617-4e35-9e8c-fb269449c8fe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:17.767197 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c0aabc5-9617-4e35-9e8c-fb269449c8fe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:17.768078 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c0aabc5-9617-4e35-9e8c-fb269449c8fe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:17.768569 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c0aabc5-9617-4e35-9e8c-fb269449c8fe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:17.826044 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a2ba7374-eae0-4482-b4c8-5b891d460907 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:17.846207 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a2ba7374-eae0-4482-b4c8-5b891d460907 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 200 len: 1318 microversion: 2.1 time: 0.705897 Apr 20 18:32:17.863655 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 41/73] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:17 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 1318 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:18.149616 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ed71e6ae-b193-41d7-8c2d-a063061f0963 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:18.153815 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ed71e6ae-b193-41d7-8c2d-a063061f0963 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:18.165611 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ed71e6ae-b193-41d7-8c2d-a063061f0963 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:18.166310 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ed71e6ae-b193-41d7-8c2d-a063061f0963 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:18.169278 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ed71e6ae-b193-41d7-8c2d-a063061f0963 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:18.169796 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ed71e6ae-b193-41d7-8c2d-a063061f0963 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:19.404509 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ed71e6ae-b193-41d7-8c2d-a063061f0963 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:19.416478 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ed71e6ae-b193-41d7-8c2d-a063061f0963 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1314 microversion: 2.1 time: 1.271864 Apr 20 18:32:19.427582 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 42/74] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:18 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1314 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:32:19.455561 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c089e1fd-d78b-4e18-8c74-2515a92fcda1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-817926308", "imageRef": "ba8326d8-5d1b-42a2-a65e-f1108a025e30", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c318347e-9762-4bfc-b74e-1d0159deb3ef"}], "security_groups": [{"name": "tempest-securitygroup--1515211149"}], "key_name": "tempest-keypair-1572287718", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:20.187430 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.network.neutron [None req-c089e1fd-d78b-4e18-8c74-2515a92fcda1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] validate_networks() for [('c318347e-9762-4bfc-b74e-1d0159deb3ef', None, None, None)] {{(pid=100592) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:32:20.468650 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3c0aabc5-9617-4e35-9e8c-fb269449c8fe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:20.495033 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3c0aabc5-9617-4e35-9e8c-fb269449c8fe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1321 microversion: 2.1 time: 2.753995 Apr 20 18:32:20.513669 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 33/75] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:17 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1321 bytes in 2774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:20.523635 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1f02bee4-1391-40a1-bb38-2178fb73b184 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:20.524914 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1f02bee4-1391-40a1-bb38-2178fb73b184 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:20.541220 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1f02bee4-1391-40a1-bb38-2178fb73b184 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:20.543430 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1f02bee4-1391-40a1-bb38-2178fb73b184 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:20.545410 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1f02bee4-1391-40a1-bb38-2178fb73b184 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:20.546334 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1f02bee4-1391-40a1-bb38-2178fb73b184 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:21.841240 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1f02bee4-1391-40a1-bb38-2178fb73b184 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:21.862429 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1f02bee4-1391-40a1-bb38-2178fb73b184 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1362 microversion: 2.1 time: 1.346936 Apr 20 18:32:21.863352 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 34/76] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:20 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1362 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:21.868856 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0956f527-fd3e-4ca1-a63a-533e265e2da8 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:21.869868 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0956f527-fd3e-4ca1-a63a-533e265e2da8 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:21.888693 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0956f527-fd3e-4ca1-a63a-533e265e2da8 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:21.889543 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0956f527-fd3e-4ca1-a63a-533e265e2da8 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:21.890618 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0956f527-fd3e-4ca1-a63a-533e265e2da8 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:21.891300 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0956f527-fd3e-4ca1-a63a-533e265e2da8 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:22.854942 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0956f527-fd3e-4ca1-a63a-533e265e2da8 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:22.870536 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0956f527-fd3e-4ca1-a63a-533e265e2da8 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 200 len: 1508 microversion: 2.1 time: 1.005113 Apr 20 18:32:22.871781 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 35/77] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:21 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 1508 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:22.880654 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-235269cc-3206-4b05-b3a0-f90ae0b93baa tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:22.881790 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-235269cc-3206-4b05-b3a0-f90ae0b93baa tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:22.894709 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-235269cc-3206-4b05-b3a0-f90ae0b93baa tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:22.895735 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-235269cc-3206-4b05-b3a0-f90ae0b93baa tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:22.897572 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-235269cc-3206-4b05-b3a0-f90ae0b93baa tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:22.898232 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-235269cc-3206-4b05-b3a0-f90ae0b93baa tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:23.521343 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-235269cc-3206-4b05-b3a0-f90ae0b93baa tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:23.537336 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-235269cc-3206-4b05-b3a0-f90ae0b93baa tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1502 microversion: 2.1 time: 0.663833 Apr 20 18:32:23.538814 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 36/78] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:22 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1502 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:23.561445 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-99160226-1431-4098-9a1c-37370d612048 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:23.574146 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-99160226-1431-4098-9a1c-37370d612048 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:23.612776 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-99160226-1431-4098-9a1c-37370d612048 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:23.613695 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-99160226-1431-4098-9a1c-37370d612048 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:23.639667 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-99160226-1431-4098-9a1c-37370d612048 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:23.640560 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-99160226-1431-4098-9a1c-37370d612048 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:24.325812 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-c089e1fd-d78b-4e18-8c74-2515a92fcda1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Flavor limits 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:32:24.327922 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-c089e1fd-d78b-4e18-8c74-2515a92fcda1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Image limits 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:32:24.330187 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-c089e1fd-d78b-4e18-8c74-2515a92fcda1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Flavor pref 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:32:24.332029 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-c089e1fd-d78b-4e18-8c74-2515a92fcda1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Image pref 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:32:24.335248 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-c089e1fd-d78b-4e18-8c74-2515a92fcda1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:32:24.405938 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c089e1fd-d78b-4e18-8c74-2515a92fcda1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:24.406993 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c089e1fd-d78b-4e18-8c74-2515a92fcda1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:24.411474 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c089e1fd-d78b-4e18-8c74-2515a92fcda1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:24.417355 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c089e1fd-d78b-4e18-8c74-2515a92fcda1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:24.528321 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-c089e1fd-d78b-4e18-8c74-2515a92fcda1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Getting quotas for project 39f3f26f55524d2d89d7c9cd7f9548f1. Resources: {'instances', 'ram', 'cores'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:32:24.538353 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-c089e1fd-d78b-4e18-8c74-2515a92fcda1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Getting quotas for user 6bc02f4b196a44a5abb1843ae0b099bf and project 39f3f26f55524d2d89d7c9cd7f9548f1. Resources: {'instances', 'ram', 'cores'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:32:24.581927 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c089e1fd-d78b-4e18-8c74-2515a92fcda1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Going to run 1 instances... {{(pid=100592) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:32:24.587539 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c089e1fd-d78b-4e18-8c74-2515a92fcda1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba8326d8-5d1b-42a2-a65e-f1108a025e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100592) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:32:24.659385 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c089e1fd-d78b-4e18-8c74-2515a92fcda1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.219491 Apr 20 18:32:24.660400 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 43/79] 10.222.0.25 () {62 vars in 1178 bytes} [Tue Apr 20 18:32:19 2021] POST /compute/v2.1/servers => generated 402 bytes in 5232 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 20 18:32:24.668057 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-15cd481f-edcc-4a6d-a057-5606e364d15f req-55cacb7e-34ae-4429-84e5-a7efa13501cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d", "name": "network-vif-plugged", "status": "completed", "tag": "4d8858cf-3006-4b33-ae23-0eeb01318afd"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:24.670483 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:32:24.670483 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:32:24.683362 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-15cd481f-edcc-4a6d-a057-5606e364d15f req-55cacb7e-34ae-4429-84e5-a7efa13501cf service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:24.684061 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-15cd481f-edcc-4a6d-a057-5606e364d15f req-55cacb7e-34ae-4429-84e5-a7efa13501cf service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:24.708743 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-15cd481f-edcc-4a6d-a057-5606e364d15f req-55cacb7e-34ae-4429-84e5-a7efa13501cf service nova] Creating event network-vif-plugged:4d8858cf-3006-4b33-ae23-0eeb01318afd for instance aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d on hv-cinder-78693 Apr 20 18:32:24.715359 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-15cd481f-edcc-4a6d-a057-5606e364d15f req-55cacb7e-34ae-4429-84e5-a7efa13501cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053253 Apr 20 18:32:24.716581 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 44/80] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:32:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:32:24.732927 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-de60847c-aaf4-4077-9604-49cb4dd4fff2 req-ee96d952-a6ea-4a26-bda3-c2559b8f9867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e676908b-5435-4bff-93a1-63e80d658fc6", "tag": "13ca762c-b03c-41e5-a456-423747f32eae"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:24.736227 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:32:24.736227 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:32:24.751054 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-de60847c-aaf4-4077-9604-49cb4dd4fff2 req-ee96d952-a6ea-4a26-bda3-c2559b8f9867 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:24.751931 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-de60847c-aaf4-4077-9604-49cb4dd4fff2 req-ee96d952-a6ea-4a26-bda3-c2559b8f9867 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:24.774293 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-de60847c-aaf4-4077-9604-49cb4dd4fff2 req-ee96d952-a6ea-4a26-bda3-c2559b8f9867 service nova] Creating event network-changed:13ca762c-b03c-41e5-a456-423747f32eae for instance e676908b-5435-4bff-93a1-63e80d658fc6 on hv-cinder-78693 Apr 20 18:32:24.789675 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-de60847c-aaf4-4077-9604-49cb4dd4fff2 req-ee96d952-a6ea-4a26-bda3-c2559b8f9867 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055921 Apr 20 18:32:24.789675 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 45/81] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:32:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:32:24.789675 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-76fe520d-4898-407b-b7a0-18018c783a2c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:24.789675 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-76fe520d-4898-407b-b7a0-18018c783a2c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:24.803608 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-76fe520d-4898-407b-b7a0-18018c783a2c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:24.803608 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-76fe520d-4898-407b-b7a0-18018c783a2c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:24.803608 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-76fe520d-4898-407b-b7a0-18018c783a2c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:24.803608 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-76fe520d-4898-407b-b7a0-18018c783a2c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:25.194234 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-99160226-1431-4098-9a1c-37370d612048 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:25.204423 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-99160226-1431-4098-9a1c-37370d612048 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1321 microversion: 2.1 time: 1.664264 Apr 20 18:32:25.205744 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 37/82] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:23 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1321 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:25.342203 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-e62dc2d6-fb60-4848-b49a-c9e5d78f2f1d req-666f26e1-5347-4c6c-90f1-ac86f4ae6302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b71640b-07ee-4677-8477-21da0a4166b1", "tag": "b561ce74-34d1-41ad-9000-53f8fd556887"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:25.350470 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:32:25.350470 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:32:25.369454 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-e62dc2d6-fb60-4848-b49a-c9e5d78f2f1d req-666f26e1-5347-4c6c-90f1-ac86f4ae6302 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:25.371238 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-e62dc2d6-fb60-4848-b49a-c9e5d78f2f1d req-666f26e1-5347-4c6c-90f1-ac86f4ae6302 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:25.422247 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-e62dc2d6-fb60-4848-b49a-c9e5d78f2f1d req-666f26e1-5347-4c6c-90f1-ac86f4ae6302 service nova] Creating event network-changed:b561ce74-34d1-41ad-9000-53f8fd556887 for instance 3b71640b-07ee-4677-8477-21da0a4166b1 on hv-cinder-78693 Apr 20 18:32:25.431378 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-e62dc2d6-fb60-4848-b49a-c9e5d78f2f1d req-666f26e1-5347-4c6c-90f1-ac86f4ae6302 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.223888 Apr 20 18:32:25.432754 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 38/83] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:32:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:32:25.451195 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4b6f231c-7acc-484d-8498-aa6a44a2be44 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:25.453714 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4b6f231c-7acc-484d-8498-aa6a44a2be44 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:25.686439 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4b6f231c-7acc-484d-8498-aa6a44a2be44 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:25.719474 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4b6f231c-7acc-484d-8498-aa6a44a2be44 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:25.722488 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4b6f231c-7acc-484d-8498-aa6a44a2be44 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:25.742722 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4b6f231c-7acc-484d-8498-aa6a44a2be44 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1281 microversion: 2.20 time: 0.284058 Apr 20 18:32:25.744225 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 39/84] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:32:25 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1281 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:32:25.763111 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8c88f65b-74b4-488b-b171-9167c565a6a1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69c4078d-0fc9-4973-a59c-81a968dc0028"}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:25.765482 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8c88f65b-74b4-488b-b171-9167c565a6a1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:25.801228 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8c88f65b-74b4-488b-b171-9167c565a6a1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:25.806250 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8c88f65b-74b4-488b-b171-9167c565a6a1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:25.808895 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8c88f65b-74b4-488b-b171-9167c565a6a1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:25.809652 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8c88f65b-74b4-488b-b171-9167c565a6a1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:26.071298 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-76fe520d-4898-407b-b7a0-18018c783a2c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:26.109840 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-76fe520d-4898-407b-b7a0-18018c783a2c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1362 microversion: 2.1 time: 1.325904 Apr 20 18:32:26.126450 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 46/85] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:24 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1362 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:26.231269 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-782ef17e-258a-4191-ae1d-2f40d24bb955 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:26.232718 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-782ef17e-258a-4191-ae1d-2f40d24bb955 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:26.265846 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-782ef17e-258a-4191-ae1d-2f40d24bb955 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:26.266625 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-782ef17e-258a-4191-ae1d-2f40d24bb955 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:26.267865 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-782ef17e-258a-4191-ae1d-2f40d24bb955 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:26.268568 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-782ef17e-258a-4191-ae1d-2f40d24bb955 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:26.888352 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8c88f65b-74b4-488b-b171-9167c565a6a1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "POST /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.140868 Apr 20 18:32:26.890800 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 40/86] 10.222.0.25 () {60 vars in 1313 bytes} [Tue Apr 20 18:32:25 2021] POST /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063/os-volume_attachments => generated 194 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:32:26.906557 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-63bbfa5a-edaf-495a-bccb-7ec022fe459a tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "901d00c6-be3a-4e84-aac0-27f272c82303"}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:26.908773 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-63bbfa5a-edaf-495a-bccb-7ec022fe459a tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:26.922245 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-63bbfa5a-edaf-495a-bccb-7ec022fe459a tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:26.923104 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-63bbfa5a-edaf-495a-bccb-7ec022fe459a tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:26.924704 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-63bbfa5a-edaf-495a-bccb-7ec022fe459a tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:26.925488 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-63bbfa5a-edaf-495a-bccb-7ec022fe459a tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:27.846271 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-782ef17e-258a-4191-ae1d-2f40d24bb955 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:27.866315 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-782ef17e-258a-4191-ae1d-2f40d24bb955 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1321 microversion: 2.1 time: 1.638296 Apr 20 18:32:27.867325 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 47/87] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:26 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1321 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:27.890356 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f5e5c25d-826c-40e7-b6fa-9c129afbcec9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:27.895442 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f5e5c25d-826c-40e7-b6fa-9c129afbcec9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:27.921176 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f5e5c25d-826c-40e7-b6fa-9c129afbcec9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:27.921997 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f5e5c25d-826c-40e7-b6fa-9c129afbcec9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:27.923239 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f5e5c25d-826c-40e7-b6fa-9c129afbcec9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:27.926023 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f5e5c25d-826c-40e7-b6fa-9c129afbcec9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:27.997302 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-63bbfa5a-edaf-495a-bccb-7ec022fe459a tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "POST /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.098382 Apr 20 18:32:28.002504 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 41/88] 10.222.0.25 () {60 vars in 1313 bytes} [Tue Apr 20 18:32:26 2021] POST /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70/os-volume_attachments => generated 194 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:32:28.018127 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5381edc4-4480-473c-8b8e-a9e57aae4e0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:28.025775 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5381edc4-4480-473c-8b8e-a9e57aae4e0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:28.045300 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5381edc4-4480-473c-8b8e-a9e57aae4e0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:28.047251 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5381edc4-4480-473c-8b8e-a9e57aae4e0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:28.051817 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5381edc4-4480-473c-8b8e-a9e57aae4e0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:28.054149 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5381edc4-4480-473c-8b8e-a9e57aae4e0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:28.363520 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5381edc4-4480-473c-8b8e-a9e57aae4e0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:28.395101 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5381edc4-4480-473c-8b8e-a9e57aae4e0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1362 microversion: 2.1 time: 0.381237 Apr 20 18:32:28.395101 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 42/89] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:28 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1362 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:28.427109 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f5e5c25d-826c-40e7-b6fa-9c129afbcec9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:28.458105 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f5e5c25d-826c-40e7-b6fa-9c129afbcec9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:28.465898 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f5e5c25d-826c-40e7-b6fa-9c129afbcec9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:28.468676 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f5e5c25d-826c-40e7-b6fa-9c129afbcec9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1339 microversion: 2.20 time: 0.585496 Apr 20 18:32:28.486907 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 48/90] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:32:27 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1339 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:32:28.887398 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-51e8dc2d-13cc-4304-b2b9-cbe2bc20a392 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:28.889020 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-51e8dc2d-13cc-4304-b2b9-cbe2bc20a392 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:28.900600 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-51e8dc2d-13cc-4304-b2b9-cbe2bc20a392 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:28.904225 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-51e8dc2d-13cc-4304-b2b9-cbe2bc20a392 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:28.906003 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-51e8dc2d-13cc-4304-b2b9-cbe2bc20a392 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:28.906631 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-51e8dc2d-13cc-4304-b2b9-cbe2bc20a392 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:29.392385 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-51e8dc2d-13cc-4304-b2b9-cbe2bc20a392 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:29.407157 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f9339609-f944-4c40-a675-4288604b3a5e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:29.408782 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f9339609-f944-4c40-a675-4288604b3a5e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:29.425096 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-51e8dc2d-13cc-4304-b2b9-cbe2bc20a392 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1321 microversion: 2.1 time: 0.544358 Apr 20 18:32:29.430756 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 43/91] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:28 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1321 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:29.447366 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f9339609-f944-4c40-a675-4288604b3a5e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:29.448553 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f9339609-f944-4c40-a675-4288604b3a5e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:29.449442 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f9339609-f944-4c40-a675-4288604b3a5e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:29.449968 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f9339609-f944-4c40-a675-4288604b3a5e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:29.503106 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-bd172436-2fee-4653-bcfe-3d9ffbe256b3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:29.503790 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-bd172436-2fee-4653-bcfe-3d9ffbe256b3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:29.520797 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bd172436-2fee-4653-bcfe-3d9ffbe256b3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:29.522063 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bd172436-2fee-4653-bcfe-3d9ffbe256b3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:29.525024 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bd172436-2fee-4653-bcfe-3d9ffbe256b3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:29.527648 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bd172436-2fee-4653-bcfe-3d9ffbe256b3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:29.773306 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-bd172436-2fee-4653-bcfe-3d9ffbe256b3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:29.786612 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-bd172436-2fee-4653-bcfe-3d9ffbe256b3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:29.788551 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-bd172436-2fee-4653-bcfe-3d9ffbe256b3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:29.790048 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-bd172436-2fee-4653-bcfe-3d9ffbe256b3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1339 microversion: 2.20 time: 0.291676 Apr 20 18:32:29.790897 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 44/92] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:32:29 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1339 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:32:30.164362 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f9339609-f944-4c40-a675-4288604b3a5e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:30.179737 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f9339609-f944-4c40-a675-4288604b3a5e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1362 microversion: 2.1 time: 0.776399 Apr 20 18:32:30.180381 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 49/93] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:29 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1362 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:30.443914 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d1843877-d318-45dd-b369-ca74bf22c6ee tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:30.444464 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d1843877-d318-45dd-b369-ca74bf22c6ee tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:30.456239 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d1843877-d318-45dd-b369-ca74bf22c6ee tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:30.457016 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d1843877-d318-45dd-b369-ca74bf22c6ee tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:30.458283 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d1843877-d318-45dd-b369-ca74bf22c6ee tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:30.458965 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d1843877-d318-45dd-b369-ca74bf22c6ee tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:30.812439 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d783c045-83ac-4a9d-9a75-46952430cc62 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:30.813045 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d783c045-83ac-4a9d-9a75-46952430cc62 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:30.833838 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d783c045-83ac-4a9d-9a75-46952430cc62 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:30.834355 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d783c045-83ac-4a9d-9a75-46952430cc62 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:30.835200 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d783c045-83ac-4a9d-9a75-46952430cc62 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:30.837382 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d783c045-83ac-4a9d-9a75-46952430cc62 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:30.940785 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d1843877-d318-45dd-b369-ca74bf22c6ee tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:30.956890 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d1843877-d318-45dd-b369-ca74bf22c6ee tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1321 microversion: 2.1 time: 0.517364 Apr 20 18:32:30.968500 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 45/94] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:30 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1321 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:31.211020 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5e346c17-542f-490c-baa6-1af0011ae002 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:31.212382 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5e346c17-542f-490c-baa6-1af0011ae002 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:31.231446 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5e346c17-542f-490c-baa6-1af0011ae002 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:31.231902 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5e346c17-542f-490c-baa6-1af0011ae002 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:31.233174 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5e346c17-542f-490c-baa6-1af0011ae002 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:31.233807 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5e346c17-542f-490c-baa6-1af0011ae002 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:31.874327 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5e346c17-542f-490c-baa6-1af0011ae002 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:31.939674 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5e346c17-542f-490c-baa6-1af0011ae002 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1362 microversion: 2.1 time: 0.736434 Apr 20 18:32:31.940819 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 46/95] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:31 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1362 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:31.982713 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-09c6a29b-b4eb-4cb0-ae4a-d2c957320150 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:31.983971 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-09c6a29b-b4eb-4cb0-ae4a-d2c957320150 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:32.029742 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-09c6a29b-b4eb-4cb0-ae4a-d2c957320150 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:32.034628 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d783c045-83ac-4a9d-9a75-46952430cc62 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:32.047735 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-09c6a29b-b4eb-4cb0-ae4a-d2c957320150 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:32.051012 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-09c6a29b-b4eb-4cb0-ae4a-d2c957320150 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:32.056415 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-09c6a29b-b4eb-4cb0-ae4a-d2c957320150 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:32.069166 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d783c045-83ac-4a9d-9a75-46952430cc62 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:32.090083 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d783c045-83ac-4a9d-9a75-46952430cc62 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:32.092560 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d783c045-83ac-4a9d-9a75-46952430cc62 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1407 microversion: 2.20 time: 1.285663 Apr 20 18:32:32.102857 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 50/96] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:32:30 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1407 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:32:32.138445 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-99b6855d-f2ec-44d7-9a29-a8fd4d29c202 req-03f7a9b9-61b0-4fdf-ac28-b108c4696236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e532f85-bed6-43d3-969d-3a2688b4638b", "tag": "36707b77-0efd-41e0-9dc6-6332c175126e"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:32.166462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:32:32.166462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:32:32.193131 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-99b6855d-f2ec-44d7-9a29-a8fd4d29c202 req-03f7a9b9-61b0-4fdf-ac28-b108c4696236 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:32.214179 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-99b6855d-f2ec-44d7-9a29-a8fd4d29c202 req-03f7a9b9-61b0-4fdf-ac28-b108c4696236 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:32.251950 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-99b6855d-f2ec-44d7-9a29-a8fd4d29c202 req-03f7a9b9-61b0-4fdf-ac28-b108c4696236 service nova] Creating event network-changed:36707b77-0efd-41e0-9dc6-6332c175126e for instance 1e532f85-bed6-43d3-969d-3a2688b4638b on hv-cinder-78693 Apr 20 18:32:32.268000 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-99b6855d-f2ec-44d7-9a29-a8fd4d29c202 req-03f7a9b9-61b0-4fdf-ac28-b108c4696236 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162543 Apr 20 18:32:32.272708 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 51/97] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:32:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:32:32.644695 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-09c6a29b-b4eb-4cb0-ae4a-d2c957320150 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:32.657914 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-09c6a29b-b4eb-4cb0-ae4a-d2c957320150 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1321 microversion: 2.1 time: 0.684322 Apr 20 18:32:32.659182 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 47/98] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:31 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1321 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:32.960585 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8c124fbb-5caf-4e62-a52f-e2f1b4839988 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:32.961606 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8c124fbb-5caf-4e62-a52f-e2f1b4839988 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:32.977960 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8c124fbb-5caf-4e62-a52f-e2f1b4839988 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:32.979694 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8c124fbb-5caf-4e62-a52f-e2f1b4839988 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:32.983268 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8c124fbb-5caf-4e62-a52f-e2f1b4839988 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:32.984037 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8c124fbb-5caf-4e62-a52f-e2f1b4839988 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:33.036931 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-e347bb74-fdd9-4697-ad7e-2377ca63e649 req-d151eee3-5df6-46f7-9fb6-df7c40582d59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b71640b-07ee-4677-8477-21da0a4166b1", "name": "network-vif-plugged", "status": "completed", "tag": "b561ce74-34d1-41ad-9000-53f8fd556887"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:33.039179 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:32:33.039179 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:32:33.070233 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-e347bb74-fdd9-4697-ad7e-2377ca63e649 req-d151eee3-5df6-46f7-9fb6-df7c40582d59 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:33.075325 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-e347bb74-fdd9-4697-ad7e-2377ca63e649 req-d151eee3-5df6-46f7-9fb6-df7c40582d59 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:33.128090 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-e347bb74-fdd9-4697-ad7e-2377ca63e649 req-d151eee3-5df6-46f7-9fb6-df7c40582d59 service nova] Creating event network-vif-plugged:b561ce74-34d1-41ad-9000-53f8fd556887 for instance 3b71640b-07ee-4677-8477-21da0a4166b1 on hv-cinder-78693 Apr 20 18:32:33.142909 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-e347bb74-fdd9-4697-ad7e-2377ca63e649 req-d151eee3-5df6-46f7-9fb6-df7c40582d59 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105262 Apr 20 18:32:33.143764 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 48/99] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:32:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:32:33.156476 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-82b55da9-1b50-4f11-97de-ff457aea65c3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:33.158979 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-82b55da9-1b50-4f11-97de-ff457aea65c3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:33.185888 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-82b55da9-1b50-4f11-97de-ff457aea65c3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:33.187003 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-82b55da9-1b50-4f11-97de-ff457aea65c3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:33.188288 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-82b55da9-1b50-4f11-97de-ff457aea65c3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:33.189023 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-82b55da9-1b50-4f11-97de-ff457aea65c3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:33.709620 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8c124fbb-5caf-4e62-a52f-e2f1b4839988 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:33.722234 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8c124fbb-5caf-4e62-a52f-e2f1b4839988 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1362 microversion: 2.1 time: 0.766840 Apr 20 18:32:33.733870 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 52/100] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:32 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1362 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:33.739593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4e59d48d-031e-4fd0-a999-16c092dfe16e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:33.740253 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4e59d48d-031e-4fd0-a999-16c092dfe16e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:33.749494 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4e59d48d-031e-4fd0-a999-16c092dfe16e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:33.750388 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4e59d48d-031e-4fd0-a999-16c092dfe16e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:33.751593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4e59d48d-031e-4fd0-a999-16c092dfe16e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:33.752262 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4e59d48d-031e-4fd0-a999-16c092dfe16e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:33.798306 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-82b55da9-1b50-4f11-97de-ff457aea65c3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:33.811358 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-82b55da9-1b50-4f11-97de-ff457aea65c3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:33.813404 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-82b55da9-1b50-4f11-97de-ff457aea65c3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:33.814726 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-82b55da9-1b50-4f11-97de-ff457aea65c3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1407 microversion: 2.20 time: 0.669631 Apr 20 18:32:33.830165 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 49/101] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:32:33 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1407 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:32:34.311419 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4e59d48d-031e-4fd0-a999-16c092dfe16e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:34.321048 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4e59d48d-031e-4fd0-a999-16c092dfe16e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1321 microversion: 2.1 time: 0.585632 Apr 20 18:32:34.321954 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 53/102] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:33 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1321 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:34.746140 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5562e8be-5692-46f0-ba2e-5b36e10562a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:34.748348 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5562e8be-5692-46f0-ba2e-5b36e10562a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:34.777503 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5562e8be-5692-46f0-ba2e-5b36e10562a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:34.778978 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5562e8be-5692-46f0-ba2e-5b36e10562a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:34.795616 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5562e8be-5692-46f0-ba2e-5b36e10562a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:34.796455 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5562e8be-5692-46f0-ba2e-5b36e10562a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:34.842447 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-33b25ede-1728-4705-9fa9-ecc846b1ab2f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:34.843172 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-33b25ede-1728-4705-9fa9-ecc846b1ab2f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:34.854602 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-33b25ede-1728-4705-9fa9-ecc846b1ab2f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:34.855537 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-33b25ede-1728-4705-9fa9-ecc846b1ab2f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:34.856983 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-33b25ede-1728-4705-9fa9-ecc846b1ab2f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:34.858448 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-33b25ede-1728-4705-9fa9-ecc846b1ab2f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:35.145051 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5562e8be-5692-46f0-ba2e-5b36e10562a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:35.167245 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5562e8be-5692-46f0-ba2e-5b36e10562a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1362 microversion: 2.1 time: 0.429731 Apr 20 18:32:35.169995 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 50/103] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:34 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1362 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:32:35.181243 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-0c2bd882-2147-4525-b98f-336b379c5ab4 req-237962ce-3c64-4b78-a006-797c61996b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e676908b-5435-4bff-93a1-63e80d658fc6", "name": "network-vif-plugged", "status": "completed", "tag": "13ca762c-b03c-41e5-a456-423747f32eae"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:35.185771 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:32:35.185771 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:32:35.204472 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-0c2bd882-2147-4525-b98f-336b379c5ab4 req-237962ce-3c64-4b78-a006-797c61996b09 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:35.205852 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-0c2bd882-2147-4525-b98f-336b379c5ab4 req-237962ce-3c64-4b78-a006-797c61996b09 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:35.232052 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-0c2bd882-2147-4525-b98f-336b379c5ab4 req-237962ce-3c64-4b78-a006-797c61996b09 service nova] Creating event network-vif-plugged:13ca762c-b03c-41e5-a456-423747f32eae for instance e676908b-5435-4bff-93a1-63e80d658fc6 on hv-cinder-78693 Apr 20 18:32:35.238341 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-0c2bd882-2147-4525-b98f-336b379c5ab4 req-237962ce-3c64-4b78-a006-797c61996b09 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066427 Apr 20 18:32:35.241811 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 51/104] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:32:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:32:35.253811 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-33b25ede-1728-4705-9fa9-ecc846b1ab2f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:35.265009 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-33b25ede-1728-4705-9fa9-ecc846b1ab2f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:35.267105 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-33b25ede-1728-4705-9fa9-ecc846b1ab2f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:35.268312 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-33b25ede-1728-4705-9fa9-ecc846b1ab2f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1407 microversion: 2.20 time: 0.433269 Apr 20 18:32:35.268938 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 54/105] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:32:34 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1407 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:32:35.345506 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-076b881a-e44b-4196-8df5-35c92ce37898 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:35.346342 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-076b881a-e44b-4196-8df5-35c92ce37898 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:35.364655 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-076b881a-e44b-4196-8df5-35c92ce37898 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:35.365779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-076b881a-e44b-4196-8df5-35c92ce37898 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:35.367534 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-076b881a-e44b-4196-8df5-35c92ce37898 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:35.368526 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-076b881a-e44b-4196-8df5-35c92ce37898 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:35.818077 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-076b881a-e44b-4196-8df5-35c92ce37898 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:35.845115 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-076b881a-e44b-4196-8df5-35c92ce37898 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1321 microversion: 2.1 time: 0.507709 Apr 20 18:32:35.846653 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 52/106] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:35 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1321 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:36.187830 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2ed8a558-b8ae-448b-9028-69a25d3d8ee7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:36.188516 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2ed8a558-b8ae-448b-9028-69a25d3d8ee7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:36.197021 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2ed8a558-b8ae-448b-9028-69a25d3d8ee7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:36.198684 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2ed8a558-b8ae-448b-9028-69a25d3d8ee7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:36.199867 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2ed8a558-b8ae-448b-9028-69a25d3d8ee7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:36.200552 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2ed8a558-b8ae-448b-9028-69a25d3d8ee7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:36.290406 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-fd11bc6d-1c3e-4c8e-a5b7-f6d6f129b902 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:36.292583 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-fd11bc6d-1c3e-4c8e-a5b7-f6d6f129b902 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:36.304425 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fd11bc6d-1c3e-4c8e-a5b7-f6d6f129b902 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:36.305316 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fd11bc6d-1c3e-4c8e-a5b7-f6d6f129b902 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:36.306576 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fd11bc6d-1c3e-4c8e-a5b7-f6d6f129b902 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:36.308567 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fd11bc6d-1c3e-4c8e-a5b7-f6d6f129b902 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:36.501784 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2ed8a558-b8ae-448b-9028-69a25d3d8ee7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:36.512102 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2ed8a558-b8ae-448b-9028-69a25d3d8ee7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1362 microversion: 2.1 time: 0.328567 Apr 20 18:32:36.519360 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 55/107] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:36 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:36.628009 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-fd11bc6d-1c3e-4c8e-a5b7-f6d6f129b902 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:36.639441 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-fd11bc6d-1c3e-4c8e-a5b7-f6d6f129b902 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:36.641517 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-fd11bc6d-1c3e-4c8e-a5b7-f6d6f129b902 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:36.642722 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-fd11bc6d-1c3e-4c8e-a5b7-f6d6f129b902 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1407 microversion: 2.20 time: 0.357357 Apr 20 18:32:36.643333 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 53/108] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:32:36 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1407 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:32:36.865831 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-56ab73dc-f18d-4d1d-a47d-46aa2e5846b4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:36.867517 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-56ab73dc-f18d-4d1d-a47d-46aa2e5846b4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:36.882696 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-56ab73dc-f18d-4d1d-a47d-46aa2e5846b4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:36.883511 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-56ab73dc-f18d-4d1d-a47d-46aa2e5846b4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:36.885444 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-56ab73dc-f18d-4d1d-a47d-46aa2e5846b4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:36.886085 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-56ab73dc-f18d-4d1d-a47d-46aa2e5846b4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:37.128023 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-56ab73dc-f18d-4d1d-a47d-46aa2e5846b4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:37.138715 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-56ab73dc-f18d-4d1d-a47d-46aa2e5846b4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1321 microversion: 2.1 time: 0.277260 Apr 20 18:32:37.139414 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 56/109] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:36 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:37.547429 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0b71d525-0721-4b7d-bd1c-810975075df9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:37.548120 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0b71d525-0721-4b7d-bd1c-810975075df9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:37.556213 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0b71d525-0721-4b7d-bd1c-810975075df9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:37.556881 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0b71d525-0721-4b7d-bd1c-810975075df9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:37.558064 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0b71d525-0721-4b7d-bd1c-810975075df9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:37.558570 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0b71d525-0721-4b7d-bd1c-810975075df9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:37.663317 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-16187401-3792-4862-b9bc-2f8aa5b117e7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:37.664013 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-16187401-3792-4862-b9bc-2f8aa5b117e7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:37.673518 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-16187401-3792-4862-b9bc-2f8aa5b117e7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:37.674035 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-16187401-3792-4862-b9bc-2f8aa5b117e7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:37.674901 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-16187401-3792-4862-b9bc-2f8aa5b117e7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:37.675409 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-16187401-3792-4862-b9bc-2f8aa5b117e7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:37.850545 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0b71d525-0721-4b7d-bd1c-810975075df9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:37.871871 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0b71d525-0721-4b7d-bd1c-810975075df9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1362 microversion: 2.1 time: 0.327935 Apr 20 18:32:37.874875 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 54/110] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:37 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:38.164314 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ae7c5a87-3074-4954-97ed-28de2f90e8c9 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:38.165047 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ae7c5a87-3074-4954-97ed-28de2f90e8c9 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:38.179366 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ae7c5a87-3074-4954-97ed-28de2f90e8c9 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:38.180196 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ae7c5a87-3074-4954-97ed-28de2f90e8c9 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:38.181433 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ae7c5a87-3074-4954-97ed-28de2f90e8c9 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:38.182634 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ae7c5a87-3074-4954-97ed-28de2f90e8c9 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:38.485965 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ae7c5a87-3074-4954-97ed-28de2f90e8c9 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:38.504182 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ae7c5a87-3074-4954-97ed-28de2f90e8c9 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1321 microversion: 2.1 time: 0.343748 Apr 20 18:32:38.508530 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 55/111] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:38 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:38.680543 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-16187401-3792-4862-b9bc-2f8aa5b117e7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:38.691022 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-16187401-3792-4862-b9bc-2f8aa5b117e7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:38.692715 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-16187401-3792-4862-b9bc-2f8aa5b117e7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:38.693972 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-16187401-3792-4862-b9bc-2f8aa5b117e7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1407 microversion: 2.20 time: 1.034844 Apr 20 18:32:38.694579 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 57/112] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:32:37 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1407 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:32:38.898581 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5a7a36a1-ef3e-4ba3-b457-6f87148dc540 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:38.899253 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5a7a36a1-ef3e-4ba3-b457-6f87148dc540 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:38.907838 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a7a36a1-ef3e-4ba3-b457-6f87148dc540 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:38.908343 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a7a36a1-ef3e-4ba3-b457-6f87148dc540 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:38.909189 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a7a36a1-ef3e-4ba3-b457-6f87148dc540 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:38.909738 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a7a36a1-ef3e-4ba3-b457-6f87148dc540 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:39.174619 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5a7a36a1-ef3e-4ba3-b457-6f87148dc540 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:39.184116 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5a7a36a1-ef3e-4ba3-b457-6f87148dc540 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1548 microversion: 2.1 time: 0.289513 Apr 20 18:32:39.184782 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 56/113] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:38 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1548 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:39.211209 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-26526574-82c8-4844-9ae1-32291dd484f6 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:39.212265 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-26526574-82c8-4844-9ae1-32291dd484f6 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:39.223195 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-26526574-82c8-4844-9ae1-32291dd484f6 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:39.223812 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-26526574-82c8-4844-9ae1-32291dd484f6 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:39.224735 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-26526574-82c8-4844-9ae1-32291dd484f6 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:39.225240 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-26526574-82c8-4844-9ae1-32291dd484f6 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:39.454527 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-26526574-82c8-4844-9ae1-32291dd484f6 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.250842 Apr 20 18:32:39.455165 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 58/114] 10.222.0.25 () {58 vars in 1265 bytes} [Tue Apr 20 18:32:39 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/os-interface => generated 285 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:32:39.530643 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0fe030dc-2db1-4edf-b59b-fad2c2cc1108 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:39.532496 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0fe030dc-2db1-4edf-b59b-fad2c2cc1108 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:39.556014 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0fe030dc-2db1-4edf-b59b-fad2c2cc1108 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:39.557731 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0fe030dc-2db1-4edf-b59b-fad2c2cc1108 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:39.559538 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0fe030dc-2db1-4edf-b59b-fad2c2cc1108 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:39.561833 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0fe030dc-2db1-4edf-b59b-fad2c2cc1108 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:39.715087 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7ced2ddd-a88c-4c19-bd99-d032e5cce661 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:39.716045 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7ced2ddd-a88c-4c19-bd99-d032e5cce661 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:39.737322 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7ced2ddd-a88c-4c19-bd99-d032e5cce661 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:39.737887 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7ced2ddd-a88c-4c19-bd99-d032e5cce661 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:39.738750 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7ced2ddd-a88c-4c19-bd99-d032e5cce661 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:39.739245 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7ced2ddd-a88c-4c19-bd99-d032e5cce661 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:40.013809 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0fe030dc-2db1-4edf-b59b-fad2c2cc1108 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:40.024998 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0fe030dc-2db1-4edf-b59b-fad2c2cc1108 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1321 microversion: 2.1 time: 0.503339 Apr 20 18:32:40.026440 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 57/115] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:39 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1321 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:40.212079 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-fa1a78ba-9315-4b11-b92d-40a1d84fe138 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-300237529", "imageRef": "ba8326d8-5d1b-42a2-a65e-f1108a025e30", "flavorRef": "452", "networks": [{"uuid": "cc0a5556-9f4f-4012-a49b-d7d22905fe39"}]}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:40.309002 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.network.neutron [None req-fa1a78ba-9315-4b11-b92d-40a1d84fe138 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] validate_networks() for [('cc0a5556-9f4f-4012-a49b-d7d22905fe39', None, None, None)] {{(pid=100593) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:32:40.760769 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7ced2ddd-a88c-4c19-bd99-d032e5cce661 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:40.786544 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7ced2ddd-a88c-4c19-bd99-d032e5cce661 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:40.789791 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7ced2ddd-a88c-4c19-bd99-d032e5cce661 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:40.795907 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7ced2ddd-a88c-4c19-bd99-d032e5cce661 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1407 microversion: 2.20 time: 1.085589 Apr 20 18:32:40.797161 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 59/116] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:32:39 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1407 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:32:41.047573 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8d8d5079-5a75-45b2-bfd9-09d1f6e07d38 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:41.048522 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8d8d5079-5a75-45b2-bfd9-09d1f6e07d38 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:41.062976 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8d8d5079-5a75-45b2-bfd9-09d1f6e07d38 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:41.064485 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8d8d5079-5a75-45b2-bfd9-09d1f6e07d38 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:41.066286 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8d8d5079-5a75-45b2-bfd9-09d1f6e07d38 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:41.067181 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8d8d5079-5a75-45b2-bfd9-09d1f6e07d38 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:41.229868 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-fa1a78ba-9315-4b11-b92d-40a1d84fe138 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Flavor limits 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:32:41.230633 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-fa1a78ba-9315-4b11-b92d-40a1d84fe138 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Image limits 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:32:41.231580 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-fa1a78ba-9315-4b11-b92d-40a1d84fe138 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Flavor pref 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:32:41.232326 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-fa1a78ba-9315-4b11-b92d-40a1d84fe138 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Image pref 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:32:41.233169 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-fa1a78ba-9315-4b11-b92d-40a1d84fe138 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:32:41.243916 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fa1a78ba-9315-4b11-b92d-40a1d84fe138 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:41.244454 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fa1a78ba-9315-4b11-b92d-40a1d84fe138 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:41.245626 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fa1a78ba-9315-4b11-b92d-40a1d84fe138 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:41.246114 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fa1a78ba-9315-4b11-b92d-40a1d84fe138 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:41.271451 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-fa1a78ba-9315-4b11-b92d-40a1d84fe138 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Getting quotas for project 122aac624a214c548b32893da89374a1. Resources: {'instances', 'ram', 'cores'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:32:41.278039 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-fa1a78ba-9315-4b11-b92d-40a1d84fe138 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Getting quotas for user 9b9bccd8af9040fd946ccb99ac8941dd and project 122aac624a214c548b32893da89374a1. Resources: {'instances', 'ram', 'cores'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:32:41.291715 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-fa1a78ba-9315-4b11-b92d-40a1d84fe138 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Going to run 1 instances... {{(pid=100593) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:32:41.294778 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-fa1a78ba-9315-4b11-b92d-40a1d84fe138 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba8326d8-5d1b-42a2-a65e-f1108a025e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:32:41.392125 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-fa1a78ba-9315-4b11-b92d-40a1d84fe138 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.158567 Apr 20 18:32:41.396601 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 58/117] 10.222.0.25 () {60 vars in 1137 bytes} [Tue Apr 20 18:32:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:32:41.408954 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-cf31ad25-f5fa-4f72-b2ee-e11d9052729d tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:41.409701 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-cf31ad25-f5fa-4f72-b2ee-e11d9052729d tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:41.580380 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-cf31ad25-f5fa-4f72-b2ee-e11d9052729d tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:41.605148 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-cf31ad25-f5fa-4f72-b2ee-e11d9052729d tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a" status: 200 len: 1217 microversion: 2.1 time: 0.199581 Apr 20 18:32:41.605782 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 59/118] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:41 2021] GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a => generated 1217 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:41.819244 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4dffd542-1b52-4b1d-a1c9-8180f4da7d7a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:41.820040 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4dffd542-1b52-4b1d-a1c9-8180f4da7d7a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:41.836067 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4dffd542-1b52-4b1d-a1c9-8180f4da7d7a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:41.836948 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4dffd542-1b52-4b1d-a1c9-8180f4da7d7a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:41.837862 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4dffd542-1b52-4b1d-a1c9-8180f4da7d7a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:41.841139 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4dffd542-1b52-4b1d-a1c9-8180f4da7d7a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:42.174913 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4dffd542-1b52-4b1d-a1c9-8180f4da7d7a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:42.186369 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4dffd542-1b52-4b1d-a1c9-8180f4da7d7a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:42.188253 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4dffd542-1b52-4b1d-a1c9-8180f4da7d7a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:42.189630 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4dffd542-1b52-4b1d-a1c9-8180f4da7d7a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1407 microversion: 2.20 time: 0.375174 Apr 20 18:32:42.190656 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 60/119] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:32:41 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1407 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:32:42.343586 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8d8d5079-5a75-45b2-bfd9-09d1f6e07d38 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:42.363373 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8d8d5079-5a75-45b2-bfd9-09d1f6e07d38 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1514 microversion: 2.1 time: 1.321820 Apr 20 18:32:42.365073 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 60/120] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:41 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1514 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:42.402432 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1ac6fdea-a8c6-46a2-baf0-8dfea1401f98 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:42.403971 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1ac6fdea-a8c6-46a2-baf0-8dfea1401f98 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:42.417185 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1ac6fdea-a8c6-46a2-baf0-8dfea1401f98 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:42.418319 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1ac6fdea-a8c6-46a2-baf0-8dfea1401f98 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:42.419535 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1ac6fdea-a8c6-46a2-baf0-8dfea1401f98 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:42.420281 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1ac6fdea-a8c6-46a2-baf0-8dfea1401f98 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:42.492602 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-887101aa-9f62-406c-b54c-3ef40eeff287 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:42.495910 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-887101aa-9f62-406c-b54c-3ef40eeff287 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:42.515177 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-887101aa-9f62-406c-b54c-3ef40eeff287 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:42.516077 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-887101aa-9f62-406c-b54c-3ef40eeff287 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:42.519773 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-887101aa-9f62-406c-b54c-3ef40eeff287 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:42.520594 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-887101aa-9f62-406c-b54c-3ef40eeff287 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:42.531726 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-1ac6fdea-a8c6-46a2-baf0-8dfea1401f98 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lazy-loading 'flavor' on Instance uuid e676908b-5435-4bff-93a1-63e80d658fc6 {{(pid=100593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:32:42.748168 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1ac6fdea-a8c6-46a2-baf0-8dfea1401f98 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "POST /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6/action" status: 200 len: 32 microversion: 2.1 time: 0.351510 Apr 20 18:32:42.748991 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 61/121] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:32:42 2021] POST /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6/action => generated 32 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:32:42.762147 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-2606c771-414c-42cf-8982-187701405acb req-6a6ab63b-8aac-4f0b-a1ce-f33ca4081024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b71640b-07ee-4677-8477-21da0a4166b1", "tag": "b561ce74-34d1-41ad-9000-53f8fd556887"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:42.764658 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:32:42.764658 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:32:42.781072 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-2606c771-414c-42cf-8982-187701405acb req-6a6ab63b-8aac-4f0b-a1ce-f33ca4081024 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:42.781665 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-2606c771-414c-42cf-8982-187701405acb req-6a6ab63b-8aac-4f0b-a1ce-f33ca4081024 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:42.835331 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-2606c771-414c-42cf-8982-187701405acb req-6a6ab63b-8aac-4f0b-a1ce-f33ca4081024 service nova] Creating event network-changed:b561ce74-34d1-41ad-9000-53f8fd556887 for instance 3b71640b-07ee-4677-8477-21da0a4166b1 on hv-cinder-78693 Apr 20 18:32:42.849891 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-2606c771-414c-42cf-8982-187701405acb req-6a6ab63b-8aac-4f0b-a1ce-f33ca4081024 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096964 Apr 20 18:32:42.850770 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 62/122] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:32:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:32:42.851504 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-887101aa-9f62-406c-b54c-3ef40eeff287 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 14 microversion: 2.1 time: 0.361989 Apr 20 18:32:42.858013 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7680ed3a-ece8-4c35-bcf3-e9d3340b2640 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:42.858808 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7680ed3a-ece8-4c35-bcf3-e9d3340b2640 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:42.859032 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 61/123] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:32:42 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 14 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:32:42.871548 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e8fd4c54-0564-453e-9952-1bfd0083702b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:42.874926 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e8fd4c54-0564-453e-9952-1bfd0083702b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:42.886691 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7680ed3a-ece8-4c35-bcf3-e9d3340b2640 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:42.887361 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7680ed3a-ece8-4c35-bcf3-e9d3340b2640 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:42.891662 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e8fd4c54-0564-453e-9952-1bfd0083702b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:42.892500 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e8fd4c54-0564-453e-9952-1bfd0083702b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:42.893639 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e8fd4c54-0564-453e-9952-1bfd0083702b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:42.894366 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e8fd4c54-0564-453e-9952-1bfd0083702b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:42.907036 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7680ed3a-ece8-4c35-bcf3-e9d3340b2640 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:42.907559 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7680ed3a-ece8-4c35-bcf3-e9d3340b2640 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:43.139843 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7680ed3a-ece8-4c35-bcf3-e9d3340b2640 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:43.150075 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7680ed3a-ece8-4c35-bcf3-e9d3340b2640 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a" status: 200 len: 1269 microversion: 2.1 time: 0.297786 Apr 20 18:32:43.153083 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 63/124] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:42 2021] GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a => generated 1269 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:43.223124 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b8d1dd7f-024a-4256-8959-e91f094ee464 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:43.223976 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b8d1dd7f-024a-4256-8959-e91f094ee464 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:43.239576 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b8d1dd7f-024a-4256-8959-e91f094ee464 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:43.240095 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b8d1dd7f-024a-4256-8959-e91f094ee464 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:43.240980 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b8d1dd7f-024a-4256-8959-e91f094ee464 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:43.241517 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b8d1dd7f-024a-4256-8959-e91f094ee464 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:43.765029 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b8d1dd7f-024a-4256-8959-e91f094ee464 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:43.810925 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b8d1dd7f-024a-4256-8959-e91f094ee464 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:43.820823 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b8d1dd7f-024a-4256-8959-e91f094ee464 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:43.844409 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b8d1dd7f-024a-4256-8959-e91f094ee464 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1407 microversion: 2.20 time: 0.625921 Apr 20 18:32:43.846657 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 64/125] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:32:43 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1407 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:32:43.872262 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0c04fd5d-e592-4ac4-8e46-5c8d0d147fde tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:43.873807 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0c04fd5d-e592-4ac4-8e46-5c8d0d147fde tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:43.893522 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0c04fd5d-e592-4ac4-8e46-5c8d0d147fde tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:43.894930 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0c04fd5d-e592-4ac4-8e46-5c8d0d147fde tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:43.902293 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0c04fd5d-e592-4ac4-8e46-5c8d0d147fde tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:43.903007 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0c04fd5d-e592-4ac4-8e46-5c8d0d147fde tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:43.942745 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e8fd4c54-0564-453e-9952-1bfd0083702b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:43.957982 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e8fd4c54-0564-453e-9952-1bfd0083702b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 1.097265 Apr 20 18:32:43.958655 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 62/126] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:42 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:44.172887 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3f120dcd-3bd9-4efa-9746-a4bf6f2ae795 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:44.173057 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0c04fd5d-e592-4ac4-8e46-5c8d0d147fde tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 14 microversion: 2.1 time: 0.306160 Apr 20 18:32:44.173609 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3f120dcd-3bd9-4efa-9746-a4bf6f2ae795 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:44.174304 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 65/127] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:32:43 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 14 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:32:44.186378 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3f120dcd-3bd9-4efa-9746-a4bf6f2ae795 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:44.187121 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3f120dcd-3bd9-4efa-9746-a4bf6f2ae795 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:44.188162 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3f120dcd-3bd9-4efa-9746-a4bf6f2ae795 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:44.198855 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3f120dcd-3bd9-4efa-9746-a4bf6f2ae795 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:44.739152 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3f120dcd-3bd9-4efa-9746-a4bf6f2ae795 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:44.778524 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3f120dcd-3bd9-4efa-9746-a4bf6f2ae795 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a" status: 200 len: 1275 microversion: 2.1 time: 0.609323 Apr 20 18:32:44.783079 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 63/128] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:44 2021] GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a => generated 1275 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:32:44.900172 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a5e98474-da64-43af-8200-be6788190653 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:44.903788 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a5e98474-da64-43af-8200-be6788190653 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:44.919838 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a5e98474-da64-43af-8200-be6788190653 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:44.920836 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a5e98474-da64-43af-8200-be6788190653 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:44.921951 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a5e98474-da64-43af-8200-be6788190653 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:44.922642 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a5e98474-da64-43af-8200-be6788190653 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:44.991344 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-eeaab60a-acb5-45ba-b880-3f5e60eee2c0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:44.992018 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-eeaab60a-acb5-45ba-b880-3f5e60eee2c0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:45.012331 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eeaab60a-acb5-45ba-b880-3f5e60eee2c0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:45.012647 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eeaab60a-acb5-45ba-b880-3f5e60eee2c0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:45.013554 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eeaab60a-acb5-45ba-b880-3f5e60eee2c0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:45.017843 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eeaab60a-acb5-45ba-b880-3f5e60eee2c0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:45.475309 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a5e98474-da64-43af-8200-be6788190653 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:45.496074 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a5e98474-da64-43af-8200-be6788190653 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:45.499396 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a5e98474-da64-43af-8200-be6788190653 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:45.506433 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a5e98474-da64-43af-8200-be6788190653 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1407 microversion: 2.20 time: 0.615767 Apr 20 18:32:45.507447 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 66/129] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:32:44 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1407 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:32:45.514653 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-dc6b1633-0524-4cfa-a81a-d9fa4248fcc7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:45.518703 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-dc6b1633-0524-4cfa-a81a-d9fa4248fcc7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:45.550922 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dc6b1633-0524-4cfa-a81a-d9fa4248fcc7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:45.552207 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dc6b1633-0524-4cfa-a81a-d9fa4248fcc7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:45.554446 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dc6b1633-0524-4cfa-a81a-d9fa4248fcc7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:45.557294 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dc6b1633-0524-4cfa-a81a-d9fa4248fcc7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:45.814877 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-dc6b1633-0524-4cfa-a81a-d9fa4248fcc7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 14 microversion: 2.1 time: 0.305179 Apr 20 18:32:45.831351 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 67/130] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:32:45 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 14 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:32:45.866470 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-40941451-a5ad-43d2-a1dd-9037406cc290 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:45.868064 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-40941451-a5ad-43d2-a1dd-9037406cc290 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:45.912175 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-40941451-a5ad-43d2-a1dd-9037406cc290 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:45.913194 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-40941451-a5ad-43d2-a1dd-9037406cc290 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:45.915139 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-40941451-a5ad-43d2-a1dd-9037406cc290 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:45.927035 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-40941451-a5ad-43d2-a1dd-9037406cc290 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:45.994270 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-eeaab60a-acb5-45ba-b880-3f5e60eee2c0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:46.027828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-eeaab60a-acb5-45ba-b880-3f5e60eee2c0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 1.040084 Apr 20 18:32:46.033767 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 64/131] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:44 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:46.547289 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3a30d1d0-a57e-4000-bdad-e0951b94f62c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:46.551605 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3a30d1d0-a57e-4000-bdad-e0951b94f62c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:46.592942 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3a30d1d0-a57e-4000-bdad-e0951b94f62c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:46.594033 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3a30d1d0-a57e-4000-bdad-e0951b94f62c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:46.598537 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3a30d1d0-a57e-4000-bdad-e0951b94f62c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:46.599323 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3a30d1d0-a57e-4000-bdad-e0951b94f62c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:47.105304 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3a30d1d0-a57e-4000-bdad-e0951b94f62c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:47.118828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3a30d1d0-a57e-4000-bdad-e0951b94f62c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:47.121431 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3a30d1d0-a57e-4000-bdad-e0951b94f62c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:47.123440 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3a30d1d0-a57e-4000-bdad-e0951b94f62c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1407 microversion: 2.20 time: 0.585279 Apr 20 18:32:47.124761 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 65/132] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:32:46 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1407 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:32:47.130446 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0b79a1aa-779c-4922-8790-a498a67eb4c7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:47.131923 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0b79a1aa-779c-4922-8790-a498a67eb4c7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:47.142327 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0b79a1aa-779c-4922-8790-a498a67eb4c7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:47.143109 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0b79a1aa-779c-4922-8790-a498a67eb4c7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:47.144749 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0b79a1aa-779c-4922-8790-a498a67eb4c7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:47.145903 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0b79a1aa-779c-4922-8790-a498a67eb4c7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:47.339722 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-40941451-a5ad-43d2-a1dd-9037406cc290 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:47.350149 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-40941451-a5ad-43d2-a1dd-9037406cc290 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a" status: 200 len: 1317 microversion: 2.1 time: 1.517123 Apr 20 18:32:47.350782 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 68/133] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:45 2021] GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a => generated 1317 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:47.355754 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c54bc3fd-d472-40c3-8ad7-a896f1932b72 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:47.356641 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c54bc3fd-d472-40c3-8ad7-a896f1932b72 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:47.365075 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0b79a1aa-779c-4922-8790-a498a67eb4c7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 14 microversion: 2.1 time: 0.238705 Apr 20 18:32:47.365943 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 66/134] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:32:47 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 14 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:32:47.372428 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-a766b415-f846-45db-b0db-9b8fda82bbf4 req-83ff434e-0a23-407d-8bbc-79847ea9213c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e532f85-bed6-43d3-969d-3a2688b4638b", "name": "network-vif-plugged", "status": "completed", "tag": "36707b77-0efd-41e0-9dc6-6332c175126e"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:47.376591 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:32:47.376591 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:32:47.384139 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c54bc3fd-d472-40c3-8ad7-a896f1932b72 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:47.385608 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c54bc3fd-d472-40c3-8ad7-a896f1932b72 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:47.386669 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c54bc3fd-d472-40c3-8ad7-a896f1932b72 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:47.387843 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c54bc3fd-d472-40c3-8ad7-a896f1932b72 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:47.408708 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-a766b415-f846-45db-b0db-9b8fda82bbf4 req-83ff434e-0a23-407d-8bbc-79847ea9213c service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:47.409490 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-a766b415-f846-45db-b0db-9b8fda82bbf4 req-83ff434e-0a23-407d-8bbc-79847ea9213c service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:47.437373 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-a766b415-f846-45db-b0db-9b8fda82bbf4 req-83ff434e-0a23-407d-8bbc-79847ea9213c service nova] Creating event network-vif-plugged:36707b77-0efd-41e0-9dc6-6332c175126e for instance 1e532f85-bed6-43d3-969d-3a2688b4638b on hv-cinder-78693 Apr 20 18:32:47.453029 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-a766b415-f846-45db-b0db-9b8fda82bbf4 req-83ff434e-0a23-407d-8bbc-79847ea9213c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085176 Apr 20 18:32:47.457372 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 67/135] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:32:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:32:47.834663 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-84fa865a-213a-4ae0-97da-c4bece3bdfec req-6ac54304-cc1c-4935-8cf7-5d8b78cda133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98d31bbe-375e-4999-b7ac-a82a2117c84a", "tag": "5744b43c-bc61-4a13-be0f-42c722995478"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:47.836522 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:32:47.836522 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:32:47.848928 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c54bc3fd-d472-40c3-8ad7-a896f1932b72 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:47.849561 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-84fa865a-213a-4ae0-97da-c4bece3bdfec req-6ac54304-cc1c-4935-8cf7-5d8b78cda133 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:47.850345 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-84fa865a-213a-4ae0-97da-c4bece3bdfec req-6ac54304-cc1c-4935-8cf7-5d8b78cda133 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:47.863020 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c54bc3fd-d472-40c3-8ad7-a896f1932b72 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.510869 Apr 20 18:32:47.878013 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 69/136] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:47 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:47.881800 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-84fa865a-213a-4ae0-97da-c4bece3bdfec req-6ac54304-cc1c-4935-8cf7-5d8b78cda133 service nova] Creating event network-changed:5744b43c-bc61-4a13-be0f-42c722995478 for instance 98d31bbe-375e-4999-b7ac-a82a2117c84a on hv-cinder-78693 Apr 20 18:32:47.892418 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-84fa865a-213a-4ae0-97da-c4bece3bdfec req-6ac54304-cc1c-4935-8cf7-5d8b78cda133 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062050 Apr 20 18:32:47.894584 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 68/137] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:32:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:32:48.144230 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-26c78dd9-eeb5-4735-99ca-e915dfca6cd2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:48.144876 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-26c78dd9-eeb5-4735-99ca-e915dfca6cd2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:48.153633 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-26c78dd9-eeb5-4735-99ca-e915dfca6cd2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:48.154311 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-26c78dd9-eeb5-4735-99ca-e915dfca6cd2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:48.155496 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-26c78dd9-eeb5-4735-99ca-e915dfca6cd2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:48.156065 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-26c78dd9-eeb5-4735-99ca-e915dfca6cd2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:48.370270 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ca924132-e960-4e1a-99d0-d97258e1841a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:48.371426 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ca924132-e960-4e1a-99d0-d97258e1841a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:48.392047 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ca924132-e960-4e1a-99d0-d97258e1841a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:48.392910 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ca924132-e960-4e1a-99d0-d97258e1841a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:48.393991 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ca924132-e960-4e1a-99d0-d97258e1841a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:48.394676 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ca924132-e960-4e1a-99d0-d97258e1841a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:48.583050 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-26c78dd9-eeb5-4735-99ca-e915dfca6cd2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:48.596709 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-26c78dd9-eeb5-4735-99ca-e915dfca6cd2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:48.598790 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-26c78dd9-eeb5-4735-99ca-e915dfca6cd2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:48.605363 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-26c78dd9-eeb5-4735-99ca-e915dfca6cd2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1407 microversion: 2.20 time: 0.460067 Apr 20 18:32:48.610091 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 70/138] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:32:48 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1407 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:32:48.616573 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-42b0a81f-2064-4f7c-9324-93f0fa76f2b5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:48.618295 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-42b0a81f-2064-4f7c-9324-93f0fa76f2b5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:48.628974 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-42b0a81f-2064-4f7c-9324-93f0fa76f2b5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:48.629689 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-42b0a81f-2064-4f7c-9324-93f0fa76f2b5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:48.630825 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-42b0a81f-2064-4f7c-9324-93f0fa76f2b5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:48.631448 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-42b0a81f-2064-4f7c-9324-93f0fa76f2b5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:48.812198 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-42b0a81f-2064-4f7c-9324-93f0fa76f2b5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 14 microversion: 2.1 time: 0.198213 Apr 20 18:32:48.814137 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 71/139] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:32:48 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 14 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:32:48.816308 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ca924132-e960-4e1a-99d0-d97258e1841a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:48.835891 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ca924132-e960-4e1a-99d0-d97258e1841a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a" status: 200 len: 1317 microversion: 2.1 time: 0.471064 Apr 20 18:32:48.836812 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 69/140] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:48 2021] GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a => generated 1317 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:32:48.894797 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c847f6c4-14c8-4154-9b93-49b412395088 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:48.896775 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c847f6c4-14c8-4154-9b93-49b412395088 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:48.919762 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c847f6c4-14c8-4154-9b93-49b412395088 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:48.920722 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c847f6c4-14c8-4154-9b93-49b412395088 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:48.922400 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c847f6c4-14c8-4154-9b93-49b412395088 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:48.923294 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c847f6c4-14c8-4154-9b93-49b412395088 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:48.978129 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-db5b60dc-539b-47fa-b920-33b3145ff82f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:48.979835 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-db5b60dc-539b-47fa-b920-33b3145ff82f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:49.003237 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-db5b60dc-539b-47fa-b920-33b3145ff82f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:49.003664 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-db5b60dc-539b-47fa-b920-33b3145ff82f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:49.004533 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-db5b60dc-539b-47fa-b920-33b3145ff82f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:49.005022 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-db5b60dc-539b-47fa-b920-33b3145ff82f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:49.153345 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-db5b60dc-539b-47fa-b920-33b3145ff82f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Going to try to terminate instance {{(pid=100592) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:32:49.266351 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c847f6c4-14c8-4154-9b93-49b412395088 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:49.277059 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c847f6c4-14c8-4154-9b93-49b412395088 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.396093 Apr 20 18:32:49.277781 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 72/141] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:48 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:49.334753 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-db5b60dc-539b-47fa-b920-33b3145ff82f tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "DELETE /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 204 len: 0 microversion: 2.1 time: 0.362480 Apr 20 18:32:49.335853 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 70/142] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:32:48 2021] DELETE /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:32:49.345609 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-83d61131-f8ef-4254-b7d9-c34694116079 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:49.346306 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-83d61131-f8ef-4254-b7d9-c34694116079 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:49.355589 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-83d61131-f8ef-4254-b7d9-c34694116079 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:49.356136 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-83d61131-f8ef-4254-b7d9-c34694116079 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:49.357257 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-83d61131-f8ef-4254-b7d9-c34694116079 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:49.357780 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-83d61131-f8ef-4254-b7d9-c34694116079 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:49.632322 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3c92ae73-edce-4c14-b2c4-a5c6a4df955c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:49.638154 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3c92ae73-edce-4c14-b2c4-a5c6a4df955c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:49.655856 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c92ae73-edce-4c14-b2c4-a5c6a4df955c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:49.657139 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c92ae73-edce-4c14-b2c4-a5c6a4df955c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:49.659019 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-83d61131-f8ef-4254-b7d9-c34694116079 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:49.659770 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c92ae73-edce-4c14-b2c4-a5c6a4df955c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:49.661324 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c92ae73-edce-4c14-b2c4-a5c6a4df955c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:49.682613 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-83d61131-f8ef-4254-b7d9-c34694116079 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1554 microversion: 2.1 time: 0.340984 Apr 20 18:32:49.683362 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 73/143] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:49 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1554 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:49.831822 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-18864b2d-766a-41e9-95e9-4300031658c4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:49.836363 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-18864b2d-766a-41e9-95e9-4300031658c4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:49.867978 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-18864b2d-766a-41e9-95e9-4300031658c4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:49.868503 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-18864b2d-766a-41e9-95e9-4300031658c4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:49.871138 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-18864b2d-766a-41e9-95e9-4300031658c4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:49.871658 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-18864b2d-766a-41e9-95e9-4300031658c4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:50.110903 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-18864b2d-766a-41e9-95e9-4300031658c4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 14 microversion: 2.1 time: 0.288651 Apr 20 18:32:50.116182 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 74/144] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:32:49 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 14 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:32:50.129299 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d1aac011-6c6e-488d-936a-9aa0d11a33bb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:50.130161 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d1aac011-6c6e-488d-936a-9aa0d11a33bb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:50.141138 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d1aac011-6c6e-488d-936a-9aa0d11a33bb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:50.141740 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d1aac011-6c6e-488d-936a-9aa0d11a33bb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:50.143120 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d1aac011-6c6e-488d-936a-9aa0d11a33bb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:50.143617 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d1aac011-6c6e-488d-936a-9aa0d11a33bb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:50.239566 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3c92ae73-edce-4c14-b2c4-a5c6a4df955c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:50.256734 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3c92ae73-edce-4c14-b2c4-a5c6a4df955c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:50.258451 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3c92ae73-edce-4c14-b2c4-a5c6a4df955c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:50.263878 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3c92ae73-edce-4c14-b2c4-a5c6a4df955c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1407 microversion: 2.20 time: 0.645666 Apr 20 18:32:50.264549 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 71/145] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:32:49 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1407 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:32:50.297310 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-69739222-4942-42c6-84db-2d9edba0dd24 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:50.298021 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-69739222-4942-42c6-84db-2d9edba0dd24 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:50.310951 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-69739222-4942-42c6-84db-2d9edba0dd24 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:50.311462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-69739222-4942-42c6-84db-2d9edba0dd24 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:50.312323 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-69739222-4942-42c6-84db-2d9edba0dd24 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:50.312817 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-69739222-4942-42c6-84db-2d9edba0dd24 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:50.439929 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d1aac011-6c6e-488d-936a-9aa0d11a33bb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:50.451690 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d1aac011-6c6e-488d-936a-9aa0d11a33bb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a" status: 200 len: 1317 microversion: 2.1 time: 0.337367 Apr 20 18:32:50.452981 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 75/146] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:50 2021] GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:50.703435 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6bf78ec3-0924-4781-bf7b-13afea662091 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:50.704118 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6bf78ec3-0924-4781-bf7b-13afea662091 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:50.712231 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6bf78ec3-0924-4781-bf7b-13afea662091 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:50.712842 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6bf78ec3-0924-4781-bf7b-13afea662091 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:50.713735 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6bf78ec3-0924-4781-bf7b-13afea662091 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:50.714440 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6bf78ec3-0924-4781-bf7b-13afea662091 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:50.832286 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-69739222-4942-42c6-84db-2d9edba0dd24 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:50.866997 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-69739222-4942-42c6-84db-2d9edba0dd24 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.574620 Apr 20 18:32:50.878814 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 72/147] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:50 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:50.994754 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6bf78ec3-0924-4781-bf7b-13afea662091 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:51.004914 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6bf78ec3-0924-4781-bf7b-13afea662091 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1554 microversion: 2.1 time: 0.305449 Apr 20 18:32:51.005597 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 76/148] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:50 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1554 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:32:51.125124 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4095aad3-639d-4447-8e17-4182bf3c16ca tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:51.126317 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4095aad3-639d-4447-8e17-4182bf3c16ca tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:51.135351 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4095aad3-639d-4447-8e17-4182bf3c16ca tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:51.135869 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4095aad3-639d-4447-8e17-4182bf3c16ca tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:51.136801 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4095aad3-639d-4447-8e17-4182bf3c16ca tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:51.137298 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4095aad3-639d-4447-8e17-4182bf3c16ca tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:51.283807 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c2b6a832-4347-48e0-b89e-e3613610af01 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:51.284471 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c2b6a832-4347-48e0-b89e-e3613610af01 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:51.294720 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c2b6a832-4347-48e0-b89e-e3613610af01 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:51.295498 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c2b6a832-4347-48e0-b89e-e3613610af01 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:51.296392 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c2b6a832-4347-48e0-b89e-e3613610af01 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:51.296967 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c2b6a832-4347-48e0-b89e-e3613610af01 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:51.323813 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4095aad3-639d-4447-8e17-4182bf3c16ca tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 14 microversion: 2.1 time: 0.202294 Apr 20 18:32:51.325302 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 73/149] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:32:51 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:32:51.472701 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e099eeb0-56d3-4375-bf9a-736288e1644a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:51.473683 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e099eeb0-56d3-4375-bf9a-736288e1644a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:51.484099 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e099eeb0-56d3-4375-bf9a-736288e1644a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:51.484966 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e099eeb0-56d3-4375-bf9a-736288e1644a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:51.485789 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e099eeb0-56d3-4375-bf9a-736288e1644a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:51.486398 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e099eeb0-56d3-4375-bf9a-736288e1644a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:51.627513 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c2b6a832-4347-48e0-b89e-e3613610af01 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:51.641542 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c2b6a832-4347-48e0-b89e-e3613610af01 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:51.643600 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c2b6a832-4347-48e0-b89e-e3613610af01 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:51.644942 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c2b6a832-4347-48e0-b89e-e3613610af01 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1599 microversion: 2.20 time: 0.365369 Apr 20 18:32:51.645863 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 77/150] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:32:51 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1599 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:32:51.670010 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7dd079ef-d631-4f99-bfa2-8aec0720a3c8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:51.670815 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7dd079ef-d631-4f99-bfa2-8aec0720a3c8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:51.679537 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7dd079ef-d631-4f99-bfa2-8aec0720a3c8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:51.680126 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7dd079ef-d631-4f99-bfa2-8aec0720a3c8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:51.680903 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7dd079ef-d631-4f99-bfa2-8aec0720a3c8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:51.681998 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7dd079ef-d631-4f99-bfa2-8aec0720a3c8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:51.783171 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e099eeb0-56d3-4375-bf9a-736288e1644a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:51.793440 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e099eeb0-56d3-4375-bf9a-736288e1644a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a" status: 200 len: 1317 microversion: 2.1 time: 0.325248 Apr 20 18:32:51.794125 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 74/151] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:51 2021] GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:32:51.865168 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7dd079ef-d631-4f99-bfa2-8aec0720a3c8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.203469 Apr 20 18:32:51.866303 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 78/152] 10.222.0.25 () {60 vars in 1306 bytes} [Tue Apr 20 18:32:51 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/os-interface => generated 284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:32:51.892212 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-905aa718-e643-43f7-94c8-5c7ebc1e0f14 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:51.893565 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-905aa718-e643-43f7-94c8-5c7ebc1e0f14 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:51.911538 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-905aa718-e643-43f7-94c8-5c7ebc1e0f14 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:51.912348 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-905aa718-e643-43f7-94c8-5c7ebc1e0f14 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:51.914045 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-905aa718-e643-43f7-94c8-5c7ebc1e0f14 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:51.915000 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-905aa718-e643-43f7-94c8-5c7ebc1e0f14 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:52.024827 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-307523bd-0772-47ed-92f3-763f4eb37259 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:52.026461 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-307523bd-0772-47ed-92f3-763f4eb37259 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:52.047699 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-307523bd-0772-47ed-92f3-763f4eb37259 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:52.048546 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-307523bd-0772-47ed-92f3-763f4eb37259 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:52.049714 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-307523bd-0772-47ed-92f3-763f4eb37259 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:52.050424 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-307523bd-0772-47ed-92f3-763f4eb37259 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:52.379399 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-307523bd-0772-47ed-92f3-763f4eb37259 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:52.422185 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-307523bd-0772-47ed-92f3-763f4eb37259 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1554 microversion: 2.1 time: 0.400663 Apr 20 18:32:52.445630 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 79/153] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:52 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1554 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:32:52.464055 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6ad9b5f2-a75e-41c9-964c-554e39034bc2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:52.470379 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6ad9b5f2-a75e-41c9-964c-554e39034bc2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:52.508619 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6ad9b5f2-a75e-41c9-964c-554e39034bc2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:52.510095 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6ad9b5f2-a75e-41c9-964c-554e39034bc2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:52.511824 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6ad9b5f2-a75e-41c9-964c-554e39034bc2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:52.512698 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6ad9b5f2-a75e-41c9-964c-554e39034bc2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:52.714709 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6ad9b5f2-a75e-41c9-964c-554e39034bc2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 14 microversion: 2.1 time: 0.266989 Apr 20 18:32:52.716305 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 80/154] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:32:52 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 14 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:32:52.818860 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c9843218-2fa1-4362-8595-c5a1eb73a7cb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:52.821075 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c9843218-2fa1-4362-8595-c5a1eb73a7cb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:52.840906 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c9843218-2fa1-4362-8595-c5a1eb73a7cb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:52.842559 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c9843218-2fa1-4362-8595-c5a1eb73a7cb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:52.845553 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c9843218-2fa1-4362-8595-c5a1eb73a7cb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:52.847345 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c9843218-2fa1-4362-8595-c5a1eb73a7cb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:52.847564 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-905aa718-e643-43f7-94c8-5c7ebc1e0f14 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:52.869454 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-905aa718-e643-43f7-94c8-5c7ebc1e0f14 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.987371 Apr 20 18:32:52.874242 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 75/155] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:51 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:53.252042 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c9843218-2fa1-4362-8595-c5a1eb73a7cb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:53.262813 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c9843218-2fa1-4362-8595-c5a1eb73a7cb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a" status: 200 len: 1317 microversion: 2.1 time: 0.454001 Apr 20 18:32:53.263714 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 81/156] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:52 2021] GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a => generated 1317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:53.462051 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f5e1e246-2705-47d6-b681-4511ad5d6962 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:53.466896 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f5e1e246-2705-47d6-b681-4511ad5d6962 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:53.486357 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f5e1e246-2705-47d6-b681-4511ad5d6962 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:53.487859 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f5e1e246-2705-47d6-b681-4511ad5d6962 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:53.489927 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f5e1e246-2705-47d6-b681-4511ad5d6962 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:53.491159 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f5e1e246-2705-47d6-b681-4511ad5d6962 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:53.735925 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1c04d7e5-c0b2-4dcd-a2dd-f6ca3f753016 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:53.748517 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1c04d7e5-c0b2-4dcd-a2dd-f6ca3f753016 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:53.765161 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1c04d7e5-c0b2-4dcd-a2dd-f6ca3f753016 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:53.766040 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1c04d7e5-c0b2-4dcd-a2dd-f6ca3f753016 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:53.767406 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1c04d7e5-c0b2-4dcd-a2dd-f6ca3f753016 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:53.768561 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1c04d7e5-c0b2-4dcd-a2dd-f6ca3f753016 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:54.038632 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1c04d7e5-c0b2-4dcd-a2dd-f6ca3f753016 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 14 microversion: 2.1 time: 0.311663 Apr 20 18:32:54.039351 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 82/157] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:32:53 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 14 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:32:54.046174 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b1853f3b-d6ef-4c27-84d2-7f5574149fb5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:54.047178 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b1853f3b-d6ef-4c27-84d2-7f5574149fb5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:54.057662 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b1853f3b-d6ef-4c27-84d2-7f5574149fb5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:54.058540 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b1853f3b-d6ef-4c27-84d2-7f5574149fb5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:54.059294 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b1853f3b-d6ef-4c27-84d2-7f5574149fb5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:54.061005 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b1853f3b-d6ef-4c27-84d2-7f5574149fb5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:54.609115 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b1853f3b-d6ef-4c27-84d2-7f5574149fb5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:54.631764 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b1853f3b-d6ef-4c27-84d2-7f5574149fb5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.591032 Apr 20 18:32:54.633009 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 83/158] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:54 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:54.645251 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2edb7e90-10e0-417f-865c-e8565b58f01a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:54.646112 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2edb7e90-10e0-417f-865c-e8565b58f01a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:54.661444 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2edb7e90-10e0-417f-865c-e8565b58f01a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:54.662450 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2edb7e90-10e0-417f-865c-e8565b58f01a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:54.662821 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2edb7e90-10e0-417f-865c-e8565b58f01a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:54.668721 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2edb7e90-10e0-417f-865c-e8565b58f01a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:54.792646 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f5e1e246-2705-47d6-b681-4511ad5d6962 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:54.809036 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f5e1e246-2705-47d6-b681-4511ad5d6962 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1554 microversion: 2.1 time: 1.354625 Apr 20 18:32:54.810163 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 76/159] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:53 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1554 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:55.039527 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2edb7e90-10e0-417f-865c-e8565b58f01a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:55.058561 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-091c2db6-5561-49f0-ac1b-3f5b2639f942 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:55.060750 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-091c2db6-5561-49f0-ac1b-3f5b2639f942 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:55.075829 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2edb7e90-10e0-417f-865c-e8565b58f01a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a" status: 200 len: 1317 microversion: 2.1 time: 0.438072 Apr 20 18:32:55.077006 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 84/160] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:54 2021] GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:55.093997 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-091c2db6-5561-49f0-ac1b-3f5b2639f942 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:55.094951 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-091c2db6-5561-49f0-ac1b-3f5b2639f942 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:55.096555 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-091c2db6-5561-49f0-ac1b-3f5b2639f942 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:55.097551 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-091c2db6-5561-49f0-ac1b-3f5b2639f942 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:55.339905 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-091c2db6-5561-49f0-ac1b-3f5b2639f942 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 14 microversion: 2.1 time: 0.290448 Apr 20 18:32:55.341022 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 77/161] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:32:55 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 14 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:32:55.653560 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2c36b587-32b9-4dc7-bc7b-5eba6ca45488 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:55.654671 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2c36b587-32b9-4dc7-bc7b-5eba6ca45488 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:55.668542 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2c36b587-32b9-4dc7-bc7b-5eba6ca45488 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:55.669518 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2c36b587-32b9-4dc7-bc7b-5eba6ca45488 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:55.671085 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2c36b587-32b9-4dc7-bc7b-5eba6ca45488 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:55.671825 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2c36b587-32b9-4dc7-bc7b-5eba6ca45488 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:55.841941 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a1badc92-6e2d-4963-969b-d8d847c59c61 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:55.843233 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a1badc92-6e2d-4963-969b-d8d847c59c61 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:55.869946 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a1badc92-6e2d-4963-969b-d8d847c59c61 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:55.870634 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a1badc92-6e2d-4963-969b-d8d847c59c61 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:55.875194 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a1badc92-6e2d-4963-969b-d8d847c59c61 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:55.878456 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a1badc92-6e2d-4963-969b-d8d847c59c61 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:55.993818 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2c36b587-32b9-4dc7-bc7b-5eba6ca45488 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:56.004539 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2c36b587-32b9-4dc7-bc7b-5eba6ca45488 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.355692 Apr 20 18:32:56.006030 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 85/162] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:55 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:56.098330 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9d391dc7-db3a-4e8f-b476-632ce38c75b6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:56.099001 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9d391dc7-db3a-4e8f-b476-632ce38c75b6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:56.119542 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9d391dc7-db3a-4e8f-b476-632ce38c75b6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:56.124103 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9d391dc7-db3a-4e8f-b476-632ce38c75b6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:56.125258 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9d391dc7-db3a-4e8f-b476-632ce38c75b6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:56.125927 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9d391dc7-db3a-4e8f-b476-632ce38c75b6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:56.313374 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a1badc92-6e2d-4963-969b-d8d847c59c61 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:56.336228 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a1badc92-6e2d-4963-969b-d8d847c59c61 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1512 microversion: 2.1 time: 0.493432 Apr 20 18:32:56.336228 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 78/163] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:55 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1512 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:56.362672 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-29708417-1177-4fdc-a73a-1b770f7c2cc7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:56.366438 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-29708417-1177-4fdc-a73a-1b770f7c2cc7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:56.396196 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29708417-1177-4fdc-a73a-1b770f7c2cc7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:56.396714 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29708417-1177-4fdc-a73a-1b770f7c2cc7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:56.400901 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29708417-1177-4fdc-a73a-1b770f7c2cc7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:56.401740 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29708417-1177-4fdc-a73a-1b770f7c2cc7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:56.402997 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9d391dc7-db3a-4e8f-b476-632ce38c75b6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:56.413677 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9d391dc7-db3a-4e8f-b476-632ce38c75b6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a" status: 200 len: 1317 microversion: 2.1 time: 0.319823 Apr 20 18:32:56.426462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 86/164] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:56 2021] GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:56.440765 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-f30ccfc2-8e8f-4751-a1d3-df0307f014ed req-b3f0dab4-887f-4085-b44a-442e0574c980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52555464-f186-4c7e-9183-b2f64ebe3c70", "name": "network-vif-deleted", "tag": "86f572d7-1e31-48f3-871a-dda81cfd9335"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:56.442668 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:32:56.442668 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:32:56.454057 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-f30ccfc2-8e8f-4751-a1d3-df0307f014ed req-b3f0dab4-887f-4085-b44a-442e0574c980 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:56.454594 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-f30ccfc2-8e8f-4751-a1d3-df0307f014ed req-b3f0dab4-887f-4085-b44a-442e0574c980 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:56.499921 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-f30ccfc2-8e8f-4751-a1d3-df0307f014ed req-b3f0dab4-887f-4085-b44a-442e0574c980 service nova] Creating event network-vif-deleted:86f572d7-1e31-48f3-871a-dda81cfd9335 for instance 52555464-f186-4c7e-9183-b2f64ebe3c70 on hv-cinder-78693 Apr 20 18:32:56.516671 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-f30ccfc2-8e8f-4751-a1d3-df0307f014ed req-b3f0dab4-887f-4085-b44a-442e0574c980 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079953 Apr 20 18:32:56.517979 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 87/165] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:32:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:32:56.656190 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2a1f4a7c-d477-4c08-b6f1-9d6b266ae70c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:56.658612 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2a1f4a7c-d477-4c08-b6f1-9d6b266ae70c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:56.677517 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-29708417-1177-4fdc-a73a-1b770f7c2cc7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 14 microversion: 2.1 time: 0.317328 Apr 20 18:32:56.677517 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 79/166] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:32:56 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 14 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:32:56.677857 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2a1f4a7c-d477-4c08-b6f1-9d6b266ae70c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:56.677857 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2a1f4a7c-d477-4c08-b6f1-9d6b266ae70c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:56.678508 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2a1f4a7c-d477-4c08-b6f1-9d6b266ae70c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:56.679541 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2a1f4a7c-d477-4c08-b6f1-9d6b266ae70c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:56.900584 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2a1f4a7c-d477-4c08-b6f1-9d6b266ae70c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 14 microversion: 2.20 time: 0.255505 Apr 20 18:32:56.907746 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 88/167] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:32:56 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 14 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:32:57.047149 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8e2c3592-3169-4d49-bb27-b0e3062faf4f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:57.048924 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8e2c3592-3169-4d49-bb27-b0e3062faf4f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:57.065521 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8e2c3592-3169-4d49-bb27-b0e3062faf4f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:57.066398 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8e2c3592-3169-4d49-bb27-b0e3062faf4f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:57.068105 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8e2c3592-3169-4d49-bb27-b0e3062faf4f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:57.068792 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8e2c3592-3169-4d49-bb27-b0e3062faf4f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:57.377846 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-88c90c81-15c1-42ed-b356-0bb46636bcb5 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:57.379947 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-88c90c81-15c1-42ed-b356-0bb46636bcb5 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:57.414427 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-88c90c81-15c1-42ed-b356-0bb46636bcb5 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:57.429581 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-88c90c81-15c1-42ed-b356-0bb46636bcb5 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:57.432768 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-88c90c81-15c1-42ed-b356-0bb46636bcb5 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:57.433908 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-88c90c81-15c1-42ed-b356-0bb46636bcb5 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:57.849964 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8e2c3592-3169-4d49-bb27-b0e3062faf4f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:57.863320 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8e2c3592-3169-4d49-bb27-b0e3062faf4f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.826419 Apr 20 18:32:57.864954 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 80/168] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:57 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:57.873218 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b53ab95b-c5b2-489b-98c6-7639b9a0ba0b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:57.874282 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b53ab95b-c5b2-489b-98c6-7639b9a0ba0b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:57.890804 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b53ab95b-c5b2-489b-98c6-7639b9a0ba0b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:57.892082 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b53ab95b-c5b2-489b-98c6-7639b9a0ba0b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:57.893236 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b53ab95b-c5b2-489b-98c6-7639b9a0ba0b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:57.893997 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b53ab95b-c5b2-489b-98c6-7639b9a0ba0b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:57.937448 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-88c90c81-15c1-42ed-b356-0bb46636bcb5 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e40470b98564885bb79041cddd975cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02402528c32649b9b9327236ec561e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:57.987275 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-88c90c81-15c1-42ed-b356-0bb46636bcb5 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 200 len: 1345 microversion: 2.1 time: 0.626853 Apr 20 18:32:57.988358 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 89/169] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:57 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 1345 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:58.028721 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9de677ef-0366-4878-9c42-c05c4e274417 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:58.030592 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9de677ef-0366-4878-9c42-c05c4e274417 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:58.065165 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9de677ef-0366-4878-9c42-c05c4e274417 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:58.074053 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9de677ef-0366-4878-9c42-c05c4e274417 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:58.076121 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9de677ef-0366-4878-9c42-c05c4e274417 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:58.077301 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9de677ef-0366-4878-9c42-c05c4e274417 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:58.456227 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9de677ef-0366-4878-9c42-c05c4e274417 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 14 microversion: 2.1 time: 0.455496 Apr 20 18:32:58.460627 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 90/170] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:32:57 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 14 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:32:58.492852 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4dc13c3f-dc2a-45ed-88e4-d669544e53db tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:58.501093 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4dc13c3f-dc2a-45ed-88e4-d669544e53db tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:58.554860 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4dc13c3f-dc2a-45ed-88e4-d669544e53db tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:58.561793 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4dc13c3f-dc2a-45ed-88e4-d669544e53db tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:58.566738 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4dc13c3f-dc2a-45ed-88e4-d669544e53db tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:58.570127 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4dc13c3f-dc2a-45ed-88e4-d669544e53db tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:58.668818 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b53ab95b-c5b2-489b-98c6-7639b9a0ba0b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:58.716025 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b53ab95b-c5b2-489b-98c6-7639b9a0ba0b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a" status: 200 len: 1317 microversion: 2.1 time: 0.849159 Apr 20 18:32:58.725582 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 81/171] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:57 2021] GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a => generated 1317 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:58.733444 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-c50abdb5-824e-4ba8-a94f-fb695111778b req-6ffeda9c-83e7-469d-931e-8cf0f444f442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d31bbe-375e-4999-b7ac-a82a2117c84a", "name": "network-vif-plugged", "status": "completed", "tag": "5744b43c-bc61-4a13-be0f-42c722995478"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:58.739898 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:32:58.739898 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:32:58.767259 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-c50abdb5-824e-4ba8-a94f-fb695111778b req-6ffeda9c-83e7-469d-931e-8cf0f444f442 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:58.768106 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-c50abdb5-824e-4ba8-a94f-fb695111778b req-6ffeda9c-83e7-469d-931e-8cf0f444f442 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:58.820535 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-c50abdb5-824e-4ba8-a94f-fb695111778b req-6ffeda9c-83e7-469d-931e-8cf0f444f442 service nova] Creating event network-vif-plugged:5744b43c-bc61-4a13-be0f-42c722995478 for instance 98d31bbe-375e-4999-b7ac-a82a2117c84a on hv-cinder-78693 Apr 20 18:32:58.836041 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-c50abdb5-824e-4ba8-a94f-fb695111778b req-6ffeda9c-83e7-469d-931e-8cf0f444f442 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113699 Apr 20 18:32:58.837362 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 82/172] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:32:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:32:58.844095 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-643e2c3e-9ae0-4cdf-b752-b01a5486510d req-34bbdd74-1d0f-4f80-b3a3-0060acff7dce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e532f85-bed6-43d3-969d-3a2688b4638b", "tag": "36707b77-0efd-41e0-9dc6-6332c175126e"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:58.846334 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:32:58.846334 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:32:58.858223 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-643e2c3e-9ae0-4cdf-b752-b01a5486510d req-34bbdd74-1d0f-4f80-b3a3-0060acff7dce service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:58.859336 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-643e2c3e-9ae0-4cdf-b752-b01a5486510d req-34bbdd74-1d0f-4f80-b3a3-0060acff7dce service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:58.881655 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-643e2c3e-9ae0-4cdf-b752-b01a5486510d req-34bbdd74-1d0f-4f80-b3a3-0060acff7dce service nova] Creating event network-changed:36707b77-0efd-41e0-9dc6-6332c175126e for instance 1e532f85-bed6-43d3-969d-3a2688b4638b on hv-cinder-78693 Apr 20 18:32:58.889429 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-643e2c3e-9ae0-4cdf-b752-b01a5486510d req-34bbdd74-1d0f-4f80-b3a3-0060acff7dce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050279 Apr 20 18:32:58.890425 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 83/173] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:32:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:32:58.901806 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3723b74d-914f-47e9-ad2c-a91663e8b40c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:58.903133 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3723b74d-914f-47e9-ad2c-a91663e8b40c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:58.923704 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3723b74d-914f-47e9-ad2c-a91663e8b40c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:58.924888 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3723b74d-914f-47e9-ad2c-a91663e8b40c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:58.926066 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3723b74d-914f-47e9-ad2c-a91663e8b40c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:58.927183 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3723b74d-914f-47e9-ad2c-a91663e8b40c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:58.952062 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4dc13c3f-dc2a-45ed-88e4-d669544e53db tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 14 microversion: 2.20 time: 0.490412 Apr 20 18:32:58.953415 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 91/174] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:32:58 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 14 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:59.024354 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6c182902-0c30-4c57-9a0c-c8ff9555f7dd tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:59.038104 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6c182902-0c30-4c57-9a0c-c8ff9555f7dd tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:59.070822 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6c182902-0c30-4c57-9a0c-c8ff9555f7dd tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:59.075314 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6c182902-0c30-4c57-9a0c-c8ff9555f7dd tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:59.076637 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6c182902-0c30-4c57-9a0c-c8ff9555f7dd tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:59.082341 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6c182902-0c30-4c57-9a0c-c8ff9555f7dd tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:59.233292 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-6c182902-0c30-4c57-9a0c-c8ff9555f7dd tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] HTTP exception thrown: Instance 52555464-f186-4c7e-9183-b2f64ebe3c70 could not be found. Apr 20 18:32:59.234436 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6c182902-0c30-4c57-9a0c-c8ff9555f7dd tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Returning 404 to user: Instance 52555464-f186-4c7e-9183-b2f64ebe3c70 could not be found. {{(pid=100593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:32:59.235575 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6c182902-0c30-4c57-9a0c-c8ff9555f7dd tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 404 len: 111 microversion: 2.1 time: 0.216396 Apr 20 18:32:59.236407 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 92/175] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:59 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 111 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:32:59.469999 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b7203a74-dd50-4f73-b336-73165135aa61 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:59.471646 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b7203a74-dd50-4f73-b336-73165135aa61 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:59.492181 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b7203a74-dd50-4f73-b336-73165135aa61 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:59.496658 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b7203a74-dd50-4f73-b336-73165135aa61 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:59.498910 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b7203a74-dd50-4f73-b336-73165135aa61 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:59.502013 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b7203a74-dd50-4f73-b336-73165135aa61 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:59.728974 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3723b74d-914f-47e9-ad2c-a91663e8b40c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:32:59.758659 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3723b74d-914f-47e9-ad2c-a91663e8b40c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.863022 Apr 20 18:32:59.761469 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 84/176] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:58 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:32:59.773956 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-38bf2952-9220-4521-af6f-7758dc5ca9c7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:32:59.777130 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-38bf2952-9220-4521-af6f-7758dc5ca9c7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:32:59.808498 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-38bf2952-9220-4521-af6f-7758dc5ca9c7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:59.809307 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b7203a74-dd50-4f73-b336-73165135aa61 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 6451 microversion: 2.1 time: 0.343589 Apr 20 18:32:59.810055 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-38bf2952-9220-4521-af6f-7758dc5ca9c7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:59.810655 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 93/177] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:32:59 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 6451 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:32:59.812166 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-38bf2952-9220-4521-af6f-7758dc5ca9c7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:32:59.813197 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-38bf2952-9220-4521-af6f-7758dc5ca9c7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:32:59.968415 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-58ef65ca-149d-4ec9-bca6-d8a88e2e76e8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:32:59.971330 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-58ef65ca-149d-4ec9-bca6-d8a88e2e76e8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:00.012377 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-58ef65ca-149d-4ec9-bca6-d8a88e2e76e8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:00.013441 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-58ef65ca-149d-4ec9-bca6-d8a88e2e76e8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:00.020535 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-58ef65ca-149d-4ec9-bca6-d8a88e2e76e8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:00.021921 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-58ef65ca-149d-4ec9-bca6-d8a88e2e76e8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:00.344468 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-58ef65ca-149d-4ec9-bca6-d8a88e2e76e8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 14 microversion: 2.20 time: 0.382360 Apr 20 18:33:00.345574 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 94/178] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:32:59 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 14 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:33:00.619513 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-38bf2952-9220-4521-af6f-7758dc5ca9c7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:00.630300 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-38bf2952-9220-4521-af6f-7758dc5ca9c7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a" status: 200 len: 1317 microversion: 2.1 time: 0.866723 Apr 20 18:33:00.637524 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 85/179] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:32:59 2021] GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a => generated 1317 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:00.779744 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-678d9aa5-b329-45e1-9008-4307586f7448 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:00.780707 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-678d9aa5-b329-45e1-9008-4307586f7448 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:00.805559 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-678d9aa5-b329-45e1-9008-4307586f7448 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:00.806931 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-678d9aa5-b329-45e1-9008-4307586f7448 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:00.808049 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-678d9aa5-b329-45e1-9008-4307586f7448 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:00.809043 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-678d9aa5-b329-45e1-9008-4307586f7448 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:00.821605 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-701bac3f-4dfc-4c92-9458-739294cc879d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:00.823790 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-701bac3f-4dfc-4c92-9458-739294cc879d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:00.834498 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-701bac3f-4dfc-4c92-9458-739294cc879d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:00.840100 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-701bac3f-4dfc-4c92-9458-739294cc879d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:00.841410 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-701bac3f-4dfc-4c92-9458-739294cc879d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:00.852157 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-701bac3f-4dfc-4c92-9458-739294cc879d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:01.107687 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-701bac3f-4dfc-4c92-9458-739294cc879d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 12459 microversion: 2.1 time: 0.289346 Apr 20 18:33:01.108486 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 86/180] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:00 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 12459 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:01.279596 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-678d9aa5-b329-45e1-9008-4307586f7448 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:01.306730 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-678d9aa5-b329-45e1-9008-4307586f7448 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.531784 Apr 20 18:33:01.307401 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 95/181] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:00 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:01.362394 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-649160ea-6407-4a2f-bb41-9f5bdbbbfd1a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:01.363600 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-649160ea-6407-4a2f-bb41-9f5bdbbbfd1a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:01.388621 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-649160ea-6407-4a2f-bb41-9f5bdbbbfd1a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:01.389178 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-649160ea-6407-4a2f-bb41-9f5bdbbbfd1a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:01.393942 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-649160ea-6407-4a2f-bb41-9f5bdbbbfd1a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:01.396105 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-649160ea-6407-4a2f-bb41-9f5bdbbbfd1a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:01.664649 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ff0f621e-f445-4216-b7c1-f7017720bb7e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:01.666340 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ff0f621e-f445-4216-b7c1-f7017720bb7e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:01.677772 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ff0f621e-f445-4216-b7c1-f7017720bb7e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:01.678732 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ff0f621e-f445-4216-b7c1-f7017720bb7e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:01.679864 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ff0f621e-f445-4216-b7c1-f7017720bb7e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:01.680543 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ff0f621e-f445-4216-b7c1-f7017720bb7e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:01.945746 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ff0f621e-f445-4216-b7c1-f7017720bb7e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:01.955178 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ff0f621e-f445-4216-b7c1-f7017720bb7e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a" status: 200 len: 1317 microversion: 2.1 time: 0.295328 Apr 20 18:33:01.955995 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 96/182] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:01 2021] GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:33:02.055255 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9d246122-9bbf-4bcf-80ff-c8ab5a79df8c tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:02.055808 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9d246122-9bbf-4bcf-80ff-c8ab5a79df8c tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:02.066868 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9d246122-9bbf-4bcf-80ff-c8ab5a79df8c tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:02.067446 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9d246122-9bbf-4bcf-80ff-c8ab5a79df8c tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:02.068413 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9d246122-9bbf-4bcf-80ff-c8ab5a79df8c tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:02.069026 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9d246122-9bbf-4bcf-80ff-c8ab5a79df8c tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:02.125357 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-9d246122-9bbf-4bcf-80ff-c8ab5a79df8c tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] HTTP exception thrown: Instance 52555464-f186-4c7e-9183-b2f64ebe3c70 could not be found. Apr 20 18:33:02.126041 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9d246122-9bbf-4bcf-80ff-c8ab5a79df8c tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Returning 404 to user: Instance 52555464-f186-4c7e-9183-b2f64ebe3c70 could not be found. {{(pid=100593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:33:02.126961 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9d246122-9bbf-4bcf-80ff-c8ab5a79df8c tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "DELETE /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 404 len: 111 microversion: 2.1 time: 0.075919 Apr 20 18:33:02.127589 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 97/183] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:33:02 2021] DELETE /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 18:33:02.132689 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-99b3ad4b-f773-414b-b29d-9bdd59a202a8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:02.133785 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-99b3ad4b-f773-414b-b29d-9bdd59a202a8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:02.143428 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-99b3ad4b-f773-414b-b29d-9bdd59a202a8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:02.143931 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-99b3ad4b-f773-414b-b29d-9bdd59a202a8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:02.144782 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-99b3ad4b-f773-414b-b29d-9bdd59a202a8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:02.145281 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-99b3ad4b-f773-414b-b29d-9bdd59a202a8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:04.342619 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-649160ea-6407-4a2f-bb41-9f5bdbbbfd1a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 14 microversion: 2.20 time: 2.984419 Apr 20 18:33:04.348791 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 87/184] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:01 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 14 bytes in 2988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:04.353916 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3d39ce9e-193b-40db-9770-09ba8493a9b7 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:04.355045 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3d39ce9e-193b-40db-9770-09ba8493a9b7 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] [instance: 52555464-f186-4c7e-9183-b2f64ebe3c70] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:04.367671 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3d39ce9e-193b-40db-9770-09ba8493a9b7 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:04.369478 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3d39ce9e-193b-40db-9770-09ba8493a9b7 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:04.371201 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3d39ce9e-193b-40db-9770-09ba8493a9b7 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:04.372481 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3d39ce9e-193b-40db-9770-09ba8493a9b7 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:04.390105 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-99b3ad4b-f773-414b-b29d-9bdd59a202a8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 17744 microversion: 2.1 time: 2.260442 Apr 20 18:33:04.391419 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 98/185] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:02 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 17744 bytes in 2263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:04.402848 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ff529bb2-7fd2-4301-993e-4170ad4017a3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:04.405695 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ff529bb2-7fd2-4301-993e-4170ad4017a3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:04.432208 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ff529bb2-7fd2-4301-993e-4170ad4017a3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:04.433225 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ff529bb2-7fd2-4301-993e-4170ad4017a3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:04.435072 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ff529bb2-7fd2-4301-993e-4170ad4017a3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:04.444003 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ff529bb2-7fd2-4301-993e-4170ad4017a3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:04.520825 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-3d39ce9e-193b-40db-9770-09ba8493a9b7 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] HTTP exception thrown: Instance 52555464-f186-4c7e-9183-b2f64ebe3c70 could not be found. Apr 20 18:33:04.522181 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3d39ce9e-193b-40db-9770-09ba8493a9b7 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] Returning 404 to user: Instance 52555464-f186-4c7e-9183-b2f64ebe3c70 could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:33:04.523766 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3d39ce9e-193b-40db-9770-09ba8493a9b7 tempest-DeleteServersTestJSON-1058441156 tempest-DeleteServersTestJSON-1058441156-project] 10.222.0.25 "GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70" status: 404 len: 111 microversion: 2.1 time: 0.177958 Apr 20 18:33:04.526473 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 88/186] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:04 2021] GET /compute/v2.1/servers/52555464-f186-4c7e-9183-b2f64ebe3c70 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:33:04.550170 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9a43528c-f599-4b12-9cff-9e7bcfe2616e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:04.551347 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9a43528c-f599-4b12-9cff-9e7bcfe2616e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:04.580101 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9a43528c-f599-4b12-9cff-9e7bcfe2616e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:04.580849 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9a43528c-f599-4b12-9cff-9e7bcfe2616e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:04.582788 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9a43528c-f599-4b12-9cff-9e7bcfe2616e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:04.583155 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9a43528c-f599-4b12-9cff-9e7bcfe2616e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:04.977520 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9a43528c-f599-4b12-9cff-9e7bcfe2616e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:04.989127 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9a43528c-f599-4b12-9cff-9e7bcfe2616e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a" status: 200 len: 1506 microversion: 2.1 time: 0.460802 Apr 20 18:33:04.989912 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 89/187] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:04 2021] GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a => generated 1506 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:05.009910 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-563aeef5-1b39-4e5d-aeef-5d5347a1a4da tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69c4078d-0fc9-4973-a59c-81a968dc0028"}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:05.011136 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-563aeef5-1b39-4e5d-aeef-5d5347a1a4da tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:05.019972 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-563aeef5-1b39-4e5d-aeef-5d5347a1a4da tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:05.020471 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-563aeef5-1b39-4e5d-aeef-5d5347a1a4da tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:05.021327 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-563aeef5-1b39-4e5d-aeef-5d5347a1a4da tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:05.021869 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-563aeef5-1b39-4e5d-aeef-5d5347a1a4da tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:05.041505 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ff529bb2-7fd2-4301-993e-4170ad4017a3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:05.059144 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ff529bb2-7fd2-4301-993e-4170ad4017a3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.661799 Apr 20 18:33:05.061038 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 99/188] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:04 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:05.257684 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-da187ad0-ffbf-4219-b920-6b216a312f44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-910307788", "imageRef": "ba8326d8-5d1b-42a2-a65e-f1108a025e30", "flavorRef": "452", "networks": [{"uuid": "a8ad5c85-66fc-46e4-a059-80fb3de0af49"}]}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:05.330541 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-563aeef5-1b39-4e5d-aeef-5d5347a1a4da tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] HTTP exception thrown: Invalid volume: volume 69c4078d-0fc9-4973-a59c-81a968dc0028 is already attached to instances: 2ba03ca2-62f0-4f02-b42f-5e99b7126063 Apr 20 18:33:05.331414 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-563aeef5-1b39-4e5d-aeef-5d5347a1a4da tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Returning 400 to user: Invalid volume: volume 69c4078d-0fc9-4973-a59c-81a968dc0028 is already attached to instances: 2ba03ca2-62f0-4f02-b42f-5e99b7126063 {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:33:05.332482 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-563aeef5-1b39-4e5d-aeef-5d5347a1a4da tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "POST /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.327535 Apr 20 18:33:05.336703 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 90/189] 10.222.0.25 () {60 vars in 1313 bytes} [Tue Apr 20 18:33:05 2021] POST /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a/os-volume_attachments => generated 174 bytes in 333 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 20 18:33:05.354276 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.network.neutron [None req-da187ad0-ffbf-4219-b920-6b216a312f44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] validate_networks() for [('a8ad5c85-66fc-46e4-a059-80fb3de0af49', None, None, None)] {{(pid=100593) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:33:05.358243 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ca5ad74a-7e60-4dd6-9ebc-f6335c4440ea tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:05.360046 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ca5ad74a-7e60-4dd6-9ebc-f6335c4440ea tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:05.383303 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ca5ad74a-7e60-4dd6-9ebc-f6335c4440ea tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:05.384355 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ca5ad74a-7e60-4dd6-9ebc-f6335c4440ea tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:05.385776 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ca5ad74a-7e60-4dd6-9ebc-f6335c4440ea tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:05.386967 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ca5ad74a-7e60-4dd6-9ebc-f6335c4440ea tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:06.178363 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-da187ad0-ffbf-4219-b920-6b216a312f44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Flavor limits 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:33:06.179354 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-da187ad0-ffbf-4219-b920-6b216a312f44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Image limits 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:33:06.180448 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-da187ad0-ffbf-4219-b920-6b216a312f44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Flavor pref 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:33:06.182845 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-da187ad0-ffbf-4219-b920-6b216a312f44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Image pref 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:33:06.182845 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-da187ad0-ffbf-4219-b920-6b216a312f44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:33:06.199835 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-da187ad0-ffbf-4219-b920-6b216a312f44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:06.200352 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-da187ad0-ffbf-4219-b920-6b216a312f44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:06.201246 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-da187ad0-ffbf-4219-b920-6b216a312f44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:06.201809 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-da187ad0-ffbf-4219-b920-6b216a312f44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:06.223462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-da187ad0-ffbf-4219-b920-6b216a312f44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Getting quotas for project c036c284f0be4d2d8e070be841f52d9c. Resources: {'instances', 'ram', 'cores'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:33:06.228610 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-da187ad0-ffbf-4219-b920-6b216a312f44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Getting quotas for user 0e6127e7600b4ec9beae1e0ce6241f60 and project c036c284f0be4d2d8e070be841f52d9c. Resources: {'instances', 'ram', 'cores'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:33:06.242640 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-da187ad0-ffbf-4219-b920-6b216a312f44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Going to run 1 instances... {{(pid=100593) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:33:06.246086 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-da187ad0-ffbf-4219-b920-6b216a312f44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba8326d8-5d1b-42a2-a65e-f1108a025e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:33:06.302856 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-da187ad0-ffbf-4219-b920-6b216a312f44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.049135 Apr 20 18:33:06.308083 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 100/190] 10.222.0.25 () {60 vars in 1137 bytes} [Tue Apr 20 18:33:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 20 18:33:06.309330 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e37a2f7e-da7a-414e-a7e1-e3d33121e165 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:06.310532 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e37a2f7e-da7a-414e-a7e1-e3d33121e165 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:06.324731 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e37a2f7e-da7a-414e-a7e1-e3d33121e165 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:06.325828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e37a2f7e-da7a-414e-a7e1-e3d33121e165 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:06.327442 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e37a2f7e-da7a-414e-a7e1-e3d33121e165 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:06.328416 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e37a2f7e-da7a-414e-a7e1-e3d33121e165 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:07.979281 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ca5ad74a-7e60-4dd6-9ebc-f6335c4440ea tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 14 microversion: 2.20 time: 2.625839 Apr 20 18:33:07.980035 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 91/191] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:05 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 14 bytes in 2628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:33:07.989039 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e42515d9-c17c-416b-85cb-9cac5b94b65b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:07.989727 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e42515d9-c17c-416b-85cb-9cac5b94b65b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:07.999411 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e42515d9-c17c-416b-85cb-9cac5b94b65b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:07.999926 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e42515d9-c17c-416b-85cb-9cac5b94b65b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:08.000793 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e42515d9-c17c-416b-85cb-9cac5b94b65b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:08.001294 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e42515d9-c17c-416b-85cb-9cac5b94b65b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:08.037556 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e37a2f7e-da7a-414e-a7e1-e3d33121e165 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 23243 microversion: 2.1 time: 1.732312 Apr 20 18:33:08.038266 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 101/192] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:06 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 23243 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:08.044925 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-eaae7c19-7181-4f4b-af78-236b3471879d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:08.047337 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-eaae7c19-7181-4f4b-af78-236b3471879d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:08.057317 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eaae7c19-7181-4f4b-af78-236b3471879d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:08.057866 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eaae7c19-7181-4f4b-af78-236b3471879d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:08.058917 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eaae7c19-7181-4f4b-af78-236b3471879d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:08.059577 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eaae7c19-7181-4f4b-af78-236b3471879d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:08.250953 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-e42515d9-c17c-416b-85cb-9cac5b94b65b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lazy-loading 'services' on Instance uuid 2ba03ca2-62f0-4f02-b42f-5e99b7126063 {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:33:08.429892 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-eaae7c19-7181-4f4b-af78-236b3471879d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:08.441184 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-eaae7c19-7181-4f4b-af78-236b3471879d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.401067 Apr 20 18:33:08.442116 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 102/193] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:08 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:08.448838 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e17617d8-5fab-4ceb-b226-d436a261f00d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:08.451936 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e17617d8-5fab-4ceb-b226-d436a261f00d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:08.461990 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e17617d8-5fab-4ceb-b226-d436a261f00d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:08.463510 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e17617d8-5fab-4ceb-b226-d436a261f00d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:08.464669 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e17617d8-5fab-4ceb-b226-d436a261f00d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:08.465300 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e17617d8-5fab-4ceb-b226-d436a261f00d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:08.551421 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e42515d9-c17c-416b-85cb-9cac5b94b65b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063/os-volume_attachments/69c4078d-0fc9-4973-a59c-81a968dc0028" status: 202 len: 0 microversion: 2.1 time: 0.565744 Apr 20 18:33:08.552885 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 92/194] 10.222.0.25 () {58 vars in 1406 bytes} [Tue Apr 20 18:33:07 2021] DELETE /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063/os-volume_attachments/69c4078d-0fc9-4973-a59c-81a968dc0028 => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:08.610572 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e17617d8-5fab-4ceb-b226-d436a261f00d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:08.622729 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e17617d8-5fab-4ceb-b226-d436a261f00d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f" status: 200 len: 1270 microversion: 2.1 time: 0.178565 Apr 20 18:33:08.624061 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 103/195] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:08 2021] GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f => generated 1270 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:08.997906 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5b9f7987-9738-4d7f-b6d7-0379265c0b77 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:09.000657 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5b9f7987-9738-4d7f-b6d7-0379265c0b77 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:09.016248 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5b9f7987-9738-4d7f-b6d7-0379265c0b77 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:09.016956 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5b9f7987-9738-4d7f-b6d7-0379265c0b77 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:09.017846 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5b9f7987-9738-4d7f-b6d7-0379265c0b77 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:09.018354 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5b9f7987-9738-4d7f-b6d7-0379265c0b77 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:09.057772 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-868882bb-6232-4c1d-9813-49955bfaef0b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:09.059273 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-868882bb-6232-4c1d-9813-49955bfaef0b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:09.092439 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-868882bb-6232-4c1d-9813-49955bfaef0b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:09.093193 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-868882bb-6232-4c1d-9813-49955bfaef0b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:09.098146 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-868882bb-6232-4c1d-9813-49955bfaef0b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:09.098871 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-868882bb-6232-4c1d-9813-49955bfaef0b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:09.302391 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5b9f7987-9738-4d7f-b6d7-0379265c0b77 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 14 microversion: 2.20 time: 0.313282 Apr 20 18:33:09.303448 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 93/196] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:08 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 14 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:09.371895 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-868882bb-6232-4c1d-9813-49955bfaef0b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 24393 microversion: 2.1 time: 0.325024 Apr 20 18:33:09.372842 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 104/197] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:09 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 24393 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:09.468521 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9925ac60-8824-4cf1-8f64-311b9770277a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:09.470555 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9925ac60-8824-4cf1-8f64-311b9770277a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:09.486904 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9925ac60-8824-4cf1-8f64-311b9770277a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:09.487579 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9925ac60-8824-4cf1-8f64-311b9770277a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:09.488539 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9925ac60-8824-4cf1-8f64-311b9770277a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:09.489271 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9925ac60-8824-4cf1-8f64-311b9770277a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:09.652439 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-07a0e9d1-7087-4e9e-b480-64865d8625f5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:09.657776 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-07a0e9d1-7087-4e9e-b480-64865d8625f5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:09.680952 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-07a0e9d1-7087-4e9e-b480-64865d8625f5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:09.683163 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-07a0e9d1-7087-4e9e-b480-64865d8625f5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:09.684120 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-07a0e9d1-7087-4e9e-b480-64865d8625f5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:09.684628 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-07a0e9d1-7087-4e9e-b480-64865d8625f5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:10.026385 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-07a0e9d1-7087-4e9e-b480-64865d8625f5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:10.063069 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-07a0e9d1-7087-4e9e-b480-64865d8625f5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f" status: 200 len: 1276 microversion: 2.1 time: 0.418262 Apr 20 18:33:10.065361 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9925ac60-8824-4cf1-8f64-311b9770277a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:10.077529 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9925ac60-8824-4cf1-8f64-311b9770277a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.619026 Apr 20 18:33:10.078628 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 94/198] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:09 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:10.086226 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 105/199] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:09 2021] GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f => generated 1276 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:10.316459 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3d7cc190-9c69-4032-add6-d9f72e8b71ec tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:10.317881 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3d7cc190-9c69-4032-add6-d9f72e8b71ec tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:10.327757 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3d7cc190-9c69-4032-add6-d9f72e8b71ec tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:10.328488 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3d7cc190-9c69-4032-add6-d9f72e8b71ec tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:10.329519 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3d7cc190-9c69-4032-add6-d9f72e8b71ec tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:10.330138 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3d7cc190-9c69-4032-add6-d9f72e8b71ec tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:10.394646 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5255dc5d-bd1d-4229-8eee-2c3c87558df9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:10.395755 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5255dc5d-bd1d-4229-8eee-2c3c87558df9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:10.410992 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5255dc5d-bd1d-4229-8eee-2c3c87558df9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:10.427389 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5255dc5d-bd1d-4229-8eee-2c3c87558df9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:10.428830 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5255dc5d-bd1d-4229-8eee-2c3c87558df9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:10.431588 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5255dc5d-bd1d-4229-8eee-2c3c87558df9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:10.511005 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3d7cc190-9c69-4032-add6-d9f72e8b71ec tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 1198 microversion: 2.20 time: 0.198774 Apr 20 18:33:10.512018 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 95/200] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:10 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 1198 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:33:10.687447 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5255dc5d-bd1d-4229-8eee-2c3c87558df9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 25082 microversion: 2.1 time: 0.304111 Apr 20 18:33:10.688823 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 106/201] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:10 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 25082 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:11.105099 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-566c8a63-23a9-40b5-bc0c-600e2a1919b6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:11.106397 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-af9216b3-217c-4699-b925-b916816c4420 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:11.107609 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-af9216b3-217c-4699-b925-b916816c4420 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:11.111264 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-566c8a63-23a9-40b5-bc0c-600e2a1919b6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:11.131768 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-566c8a63-23a9-40b5-bc0c-600e2a1919b6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:11.135762 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-af9216b3-217c-4699-b925-b916816c4420 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:11.138151 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-af9216b3-217c-4699-b925-b916816c4420 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:11.143165 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-566c8a63-23a9-40b5-bc0c-600e2a1919b6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:11.144298 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-af9216b3-217c-4699-b925-b916816c4420 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:11.145308 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-566c8a63-23a9-40b5-bc0c-600e2a1919b6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:11.145919 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-af9216b3-217c-4699-b925-b916816c4420 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:11.151357 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-566c8a63-23a9-40b5-bc0c-600e2a1919b6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:11.769044 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-566c8a63-23a9-40b5-bc0c-600e2a1919b6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:11.789798 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-566c8a63-23a9-40b5-bc0c-600e2a1919b6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.690391 Apr 20 18:33:11.792094 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 107/202] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:11 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:11.813377 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-04b6ca10-1edb-4f76-b495-29785e60b3a6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1559452887", "imageRef": "ba8326d8-5d1b-42a2-a65e-f1108a025e30", "flavorRef": "452", "networks": [{"uuid": "cc0a5556-9f4f-4012-a49b-d7d22905fe39"}]}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:11.819593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-af9216b3-217c-4699-b925-b916816c4420 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:11.842792 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-af9216b3-217c-4699-b925-b916816c4420 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f" status: 200 len: 1318 microversion: 2.1 time: 0.748525 Apr 20 18:33:11.846264 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 96/203] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:11 2021] GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f => generated 1318 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:11.858164 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-58e1e0df-c38c-4e62-9484-403d558f7fe3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:11.861231 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-58e1e0df-c38c-4e62-9484-403d558f7fe3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:11.878999 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-58e1e0df-c38c-4e62-9484-403d558f7fe3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:11.880171 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-58e1e0df-c38c-4e62-9484-403d558f7fe3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:11.881908 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-58e1e0df-c38c-4e62-9484-403d558f7fe3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:11.882904 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-58e1e0df-c38c-4e62-9484-403d558f7fe3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:12.066792 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-58e1e0df-c38c-4e62-9484-403d558f7fe3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 8310 microversion: 2.20 time: 0.216721 Apr 20 18:33:12.068507 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 97/204] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:11 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 8310 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:33:12.084174 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-83a0f3b3-7cb0-4bac-b1db-88c1762c9050 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:12.087418 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-83a0f3b3-7cb0-4bac-b1db-88c1762c9050 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:12.087715 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.network.neutron [None req-04b6ca10-1edb-4f76-b495-29785e60b3a6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] validate_networks() for [('cc0a5556-9f4f-4012-a49b-d7d22905fe39', None, None, None)] {{(pid=100593) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:33:12.110346 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-83a0f3b3-7cb0-4bac-b1db-88c1762c9050 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:12.111264 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-83a0f3b3-7cb0-4bac-b1db-88c1762c9050 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:12.114017 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-83a0f3b3-7cb0-4bac-b1db-88c1762c9050 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:12.115002 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-83a0f3b3-7cb0-4bac-b1db-88c1762c9050 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:12.316971 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-83a0f3b3-7cb0-4bac-b1db-88c1762c9050 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 26047 microversion: 2.1 time: 0.245711 Apr 20 18:33:12.317816 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 98/205] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:12 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 26047 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:12.823443 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-848a40f9-bdf4-4060-80c6-ed347e3cbdef tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:12.824421 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-848a40f9-bdf4-4060-80c6-ed347e3cbdef tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:12.844553 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-848a40f9-bdf4-4060-80c6-ed347e3cbdef tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:12.845986 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-848a40f9-bdf4-4060-80c6-ed347e3cbdef tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:12.849751 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-848a40f9-bdf4-4060-80c6-ed347e3cbdef tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:12.850894 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-848a40f9-bdf4-4060-80c6-ed347e3cbdef tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:13.440534 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-848a40f9-bdf4-4060-80c6-ed347e3cbdef tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:13.452983 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-848a40f9-bdf4-4060-80c6-ed347e3cbdef tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.635782 Apr 20 18:33:13.454743 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 99/206] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:12 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:33:13.460410 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8bdf472c-10ae-4fd4-a6c1-dcebcec56a4d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:13.461381 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8bdf472c-10ae-4fd4-a6c1-dcebcec56a4d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:13.471689 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-04b6ca10-1edb-4f76-b495-29785e60b3a6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Flavor limits 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:33:13.472443 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-04b6ca10-1edb-4f76-b495-29785e60b3a6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Image limits 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:33:13.473044 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-04b6ca10-1edb-4f76-b495-29785e60b3a6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Flavor pref 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:33:13.473653 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-04b6ca10-1edb-4f76-b495-29785e60b3a6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Image pref 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:33:13.474188 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-04b6ca10-1edb-4f76-b495-29785e60b3a6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:33:13.476013 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8bdf472c-10ae-4fd4-a6c1-dcebcec56a4d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:13.477091 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8bdf472c-10ae-4fd4-a6c1-dcebcec56a4d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:13.479275 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8bdf472c-10ae-4fd4-a6c1-dcebcec56a4d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:13.479708 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8bdf472c-10ae-4fd4-a6c1-dcebcec56a4d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:13.491401 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-04b6ca10-1edb-4f76-b495-29785e60b3a6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:13.492318 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-04b6ca10-1edb-4f76-b495-29785e60b3a6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:13.494019 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-04b6ca10-1edb-4f76-b495-29785e60b3a6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:13.496278 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-04b6ca10-1edb-4f76-b495-29785e60b3a6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:13.548211 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-04b6ca10-1edb-4f76-b495-29785e60b3a6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Getting quotas for project 122aac624a214c548b32893da89374a1. Resources: {'instances', 'ram', 'cores'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:33:13.553453 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-04b6ca10-1edb-4f76-b495-29785e60b3a6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Getting quotas for user 9b9bccd8af9040fd946ccb99ac8941dd and project 122aac624a214c548b32893da89374a1. Resources: {'instances', 'ram', 'cores'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:33:13.569822 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-04b6ca10-1edb-4f76-b495-29785e60b3a6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Going to run 1 instances... {{(pid=100593) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:33:13.574626 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-04b6ca10-1edb-4f76-b495-29785e60b3a6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba8326d8-5d1b-42a2-a65e-f1108a025e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:33:13.640861 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-04b6ca10-1edb-4f76-b495-29785e60b3a6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.846687 Apr 20 18:33:13.645135 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 108/207] 10.222.0.25 () {60 vars in 1137 bytes} [Tue Apr 20 18:33:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 1852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:33:13.652674 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b85dc89c-f205-4029-8c73-78b54e028e9a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:13.657793 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b85dc89c-f205-4029-8c73-78b54e028e9a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:13.680517 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b85dc89c-f205-4029-8c73-78b54e028e9a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:13.681083 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b85dc89c-f205-4029-8c73-78b54e028e9a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:13.682134 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b85dc89c-f205-4029-8c73-78b54e028e9a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:13.682634 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b85dc89c-f205-4029-8c73-78b54e028e9a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:13.866433 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b85dc89c-f205-4029-8c73-78b54e028e9a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 15025 microversion: 2.20 time: 0.218945 Apr 20 18:33:13.871752 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 109/208] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:13 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 15025 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:13.883721 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-fa44f6d6-b436-4d2a-bec8-67b5a630ae0e req-e868502b-b249-4908-8eab-947ec945258d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec63aa76-1efa-45ed-8e4d-89794690776f", "tag": "06a72144-d46d-42ad-aef8-3b655cd2b4c6"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:13.888869 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:33:13.888869 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:33:13.914388 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-fa44f6d6-b436-4d2a-bec8-67b5a630ae0e req-e868502b-b249-4908-8eab-947ec945258d service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:13.915582 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-fa44f6d6-b436-4d2a-bec8-67b5a630ae0e req-e868502b-b249-4908-8eab-947ec945258d service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:13.965933 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-fa44f6d6-b436-4d2a-bec8-67b5a630ae0e req-e868502b-b249-4908-8eab-947ec945258d service nova] Creating event network-changed:06a72144-d46d-42ad-aef8-3b655cd2b4c6 for instance ec63aa76-1efa-45ed-8e4d-89794690776f on hv-cinder-78693 Apr 20 18:33:13.972429 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-fa44f6d6-b436-4d2a-bec8-67b5a630ae0e req-e868502b-b249-4908-8eab-947ec945258d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101358 Apr 20 18:33:13.973574 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 110/209] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:33:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:33:13.981089 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ea3d1a16-c7cc-4054-953c-55a07357e052 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:13.982820 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ea3d1a16-c7cc-4054-953c-55a07357e052 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:13.991843 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ea3d1a16-c7cc-4054-953c-55a07357e052 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:13.992538 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ea3d1a16-c7cc-4054-953c-55a07357e052 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:13.994808 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ea3d1a16-c7cc-4054-953c-55a07357e052 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:13.995525 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ea3d1a16-c7cc-4054-953c-55a07357e052 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:14.153005 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ea3d1a16-c7cc-4054-953c-55a07357e052 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 26800 microversion: 2.1 time: 0.177685 Apr 20 18:33:14.154215 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 111/210] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:13 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 26800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:14.162629 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-bbc61ddb-ce7e-422d-95fb-cf7e707b46b8 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:14.164285 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-bbc61ddb-ce7e-422d-95fb-cf7e707b46b8 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:14.177068 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8bdf472c-10ae-4fd4-a6c1-dcebcec56a4d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:14.197740 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8bdf472c-10ae-4fd4-a6c1-dcebcec56a4d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f" status: 200 len: 1318 microversion: 2.1 time: 0.740645 Apr 20 18:33:14.202588 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 100/211] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:13 2021] GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f => generated 1318 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:14.477700 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6924dd2c-bbda-4015-8ad8-b61f9436b6bd tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:14.479187 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6924dd2c-bbda-4015-8ad8-b61f9436b6bd tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:14.497615 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6924dd2c-bbda-4015-8ad8-b61f9436b6bd tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:14.498559 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6924dd2c-bbda-4015-8ad8-b61f9436b6bd tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:14.499669 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6924dd2c-bbda-4015-8ad8-b61f9436b6bd tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:14.503757 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6924dd2c-bbda-4015-8ad8-b61f9436b6bd tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:15.078171 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-bbc61ddb-ce7e-422d-95fb-cf7e707b46b8 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:15.092203 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-bbc61ddb-ce7e-422d-95fb-cf7e707b46b8 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 200 len: 1218 microversion: 2.1 time: 0.936591 Apr 20 18:33:15.092853 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 112/212] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:14 2021] GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 1218 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:15.099633 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6924dd2c-bbda-4015-8ad8-b61f9436b6bd tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:15.108237 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-593842be-9c2a-4cc7-9622-2f023b35de93 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:15.109322 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-593842be-9c2a-4cc7-9622-2f023b35de93 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:15.116307 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6924dd2c-bbda-4015-8ad8-b61f9436b6bd tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.643053 Apr 20 18:33:15.119766 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 101/213] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:14 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:15.138994 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-593842be-9c2a-4cc7-9622-2f023b35de93 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:15.139943 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-593842be-9c2a-4cc7-9622-2f023b35de93 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:15.150256 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-593842be-9c2a-4cc7-9622-2f023b35de93 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:15.151443 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-593842be-9c2a-4cc7-9622-2f023b35de93 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:15.168907 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-186cf9d9-a983-4de5-bc83-4063e65ed021 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:15.170111 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-186cf9d9-a983-4de5-bc83-4063e65ed021 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:15.193260 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-186cf9d9-a983-4de5-bc83-4063e65ed021 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:15.194059 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-186cf9d9-a983-4de5-bc83-4063e65ed021 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:15.195071 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-186cf9d9-a983-4de5-bc83-4063e65ed021 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:15.195718 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-186cf9d9-a983-4de5-bc83-4063e65ed021 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:15.437281 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-186cf9d9-a983-4de5-bc83-4063e65ed021 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 27206 microversion: 2.1 time: 0.273327 Apr 20 18:33:15.438150 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 102/214] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:15 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 27206 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:15.448464 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-cd0ea692-4f99-4c11-b4d6-80dcd6d58b4c tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:15.449545 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-cd0ea692-4f99-4c11-b4d6-80dcd6d58b4c tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:15.458474 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cd0ea692-4f99-4c11-b4d6-80dcd6d58b4c tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:15.459353 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cd0ea692-4f99-4c11-b4d6-80dcd6d58b4c tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:15.460378 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cd0ea692-4f99-4c11-b4d6-80dcd6d58b4c tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:15.461227 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cd0ea692-4f99-4c11-b4d6-80dcd6d58b4c tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:15.511740 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-593842be-9c2a-4cc7-9622-2f023b35de93 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 17781 microversion: 2.20 time: 0.408635 Apr 20 18:33:15.513100 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 113/215] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:15 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 17781 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:16.086359 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-cd0ea692-4f99-4c11-b4d6-80dcd6d58b4c tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:16.111965 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-fa6e4e86-8793-4b9f-891e-70b3e0ad062d tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:16.112740 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-fa6e4e86-8793-4b9f-891e-70b3e0ad062d tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:16.118683 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-cd0ea692-4f99-4c11-b4d6-80dcd6d58b4c tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f" status: 200 len: 1318 microversion: 2.1 time: 0.666338 Apr 20 18:33:16.119370 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 103/216] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:15 2021] GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f => generated 1318 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:16.130966 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fa6e4e86-8793-4b9f-891e-70b3e0ad062d tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:16.137257 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9038448f-0221-4e83-aa9b-204d0f8152b6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:16.137978 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9038448f-0221-4e83-aa9b-204d0f8152b6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:16.142348 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fa6e4e86-8793-4b9f-891e-70b3e0ad062d tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:16.143045 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fa6e4e86-8793-4b9f-891e-70b3e0ad062d tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:16.143540 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fa6e4e86-8793-4b9f-891e-70b3e0ad062d tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:16.167594 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9038448f-0221-4e83-aa9b-204d0f8152b6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:16.168829 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9038448f-0221-4e83-aa9b-204d0f8152b6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:16.170377 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9038448f-0221-4e83-aa9b-204d0f8152b6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:16.178164 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9038448f-0221-4e83-aa9b-204d0f8152b6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:16.464030 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-fa6e4e86-8793-4b9f-891e-70b3e0ad062d tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:16.484199 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-fa6e4e86-8793-4b9f-891e-70b3e0ad062d tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 200 len: 1278 microversion: 2.1 time: 0.373557 Apr 20 18:33:16.487621 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 114/217] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:16 2021] GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 1278 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:16.501789 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a36a2929-3dbc-42b3-baf3-9113fecd1d40 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:16.506025 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a36a2929-3dbc-42b3-baf3-9113fecd1d40 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:16.529136 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a36a2929-3dbc-42b3-baf3-9113fecd1d40 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:16.532859 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a36a2929-3dbc-42b3-baf3-9113fecd1d40 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:16.535319 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a36a2929-3dbc-42b3-baf3-9113fecd1d40 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:16.535995 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a36a2929-3dbc-42b3-baf3-9113fecd1d40 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:16.733438 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a36a2929-3dbc-42b3-baf3-9113fecd1d40 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 27554 microversion: 2.1 time: 0.243937 Apr 20 18:33:16.734530 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 115/218] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:16 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 27554 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:16.741201 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4680e17c-60f0-4f76-8937-4f3c7ae6cb24 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:16.743123 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4680e17c-60f0-4f76-8937-4f3c7ae6cb24 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:16.762828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4680e17c-60f0-4f76-8937-4f3c7ae6cb24 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:16.767092 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4680e17c-60f0-4f76-8937-4f3c7ae6cb24 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:16.769578 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4680e17c-60f0-4f76-8937-4f3c7ae6cb24 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:16.771184 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4680e17c-60f0-4f76-8937-4f3c7ae6cb24 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:16.831648 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9038448f-0221-4e83-aa9b-204d0f8152b6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:16.847442 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9038448f-0221-4e83-aa9b-204d0f8152b6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.714488 Apr 20 18:33:16.848208 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 104/219] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:16 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:16.959964 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4680e17c-60f0-4f76-8937-4f3c7ae6cb24 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 19133 microversion: 2.20 time: 0.223412 Apr 20 18:33:16.962476 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 116/220] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:16 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 19133 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:17.136976 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-dbc1332c-16ff-4af0-b71f-c79f4da3ab52 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:17.137708 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-dbc1332c-16ff-4af0-b71f-c79f4da3ab52 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:17.148131 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dbc1332c-16ff-4af0-b71f-c79f4da3ab52 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:17.148131 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dbc1332c-16ff-4af0-b71f-c79f4da3ab52 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:17.148409 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dbc1332c-16ff-4af0-b71f-c79f4da3ab52 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:17.149047 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dbc1332c-16ff-4af0-b71f-c79f4da3ab52 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:17.405820 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-dbc1332c-16ff-4af0-b71f-c79f4da3ab52 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:17.416650 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-dbc1332c-16ff-4af0-b71f-c79f4da3ab52 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f" status: 200 len: 1318 microversion: 2.1 time: 0.284133 Apr 20 18:33:17.417881 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 105/221] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:17 2021] GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:17.503851 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-75b014f5-a0d6-4813-89b4-bb95ccb97492 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:17.504891 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-75b014f5-a0d6-4813-89b4-bb95ccb97492 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:17.514967 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-75b014f5-a0d6-4813-89b4-bb95ccb97492 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:17.515476 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-75b014f5-a0d6-4813-89b4-bb95ccb97492 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:17.516447 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-75b014f5-a0d6-4813-89b4-bb95ccb97492 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:17.516949 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-75b014f5-a0d6-4813-89b4-bb95ccb97492 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:17.748216 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b5c069af-20b6-49c7-89a1-97384c2a24f5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:17.753724 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b5c069af-20b6-49c7-89a1-97384c2a24f5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:17.767971 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b5c069af-20b6-49c7-89a1-97384c2a24f5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:17.769119 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b5c069af-20b6-49c7-89a1-97384c2a24f5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:17.770436 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b5c069af-20b6-49c7-89a1-97384c2a24f5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:17.771854 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b5c069af-20b6-49c7-89a1-97384c2a24f5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:17.849787 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-75b014f5-a0d6-4813-89b4-bb95ccb97492 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:17.861980 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-75b014f5-a0d6-4813-89b4-bb95ccb97492 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 200 len: 1318 microversion: 2.1 time: 0.361408 Apr 20 18:33:17.861980 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 117/222] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:17 2021] GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:17.878260 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-bb6d5374-d862-42fd-a061-fa7f27110e1a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:17.878943 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-bb6d5374-d862-42fd-a061-fa7f27110e1a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:17.887975 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bb6d5374-d862-42fd-a061-fa7f27110e1a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:17.888493 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bb6d5374-d862-42fd-a061-fa7f27110e1a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:17.889347 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bb6d5374-d862-42fd-a061-fa7f27110e1a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:17.889930 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bb6d5374-d862-42fd-a061-fa7f27110e1a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:18.141833 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-bb6d5374-d862-42fd-a061-fa7f27110e1a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:18.163639 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-bb6d5374-d862-42fd-a061-fa7f27110e1a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.289398 Apr 20 18:33:18.182089 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 118/223] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:17 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:18.184782 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8466912d-2b4c-4d8b-b086-a4a21976b864 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:18.187576 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8466912d-2b4c-4d8b-b086-a4a21976b864 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:18.201441 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8466912d-2b4c-4d8b-b086-a4a21976b864 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:18.202262 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8466912d-2b4c-4d8b-b086-a4a21976b864 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:18.203715 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8466912d-2b4c-4d8b-b086-a4a21976b864 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:18.204442 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8466912d-2b4c-4d8b-b086-a4a21976b864 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:19.955967 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b5c069af-20b6-49c7-89a1-97384c2a24f5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 27854 microversion: 2.1 time: 2.213631 Apr 20 18:33:19.956919 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 106/224] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:17 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 27854 bytes in 2216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:19.969649 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-551ee8c2-75b5-4e90-ab15-7c05e8cb39e7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:19.972437 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-551ee8c2-75b5-4e90-ab15-7c05e8cb39e7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:19.982894 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-551ee8c2-75b5-4e90-ab15-7c05e8cb39e7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:19.983736 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-551ee8c2-75b5-4e90-ab15-7c05e8cb39e7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:19.984791 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-551ee8c2-75b5-4e90-ab15-7c05e8cb39e7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:19.985523 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-551ee8c2-75b5-4e90-ab15-7c05e8cb39e7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:20.013457 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8466912d-2b4c-4d8b-b086-a4a21976b864 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 23235 microversion: 2.20 time: 1.836575 Apr 20 18:33:20.014530 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 119/225] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:18 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 23235 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:20.020518 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-651f3540-7f90-4c12-93d5-cff780a6c13b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:20.034477 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-651f3540-7f90-4c12-93d5-cff780a6c13b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:20.048570 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-651f3540-7f90-4c12-93d5-cff780a6c13b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:20.049205 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-651f3540-7f90-4c12-93d5-cff780a6c13b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:20.050979 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-651f3540-7f90-4c12-93d5-cff780a6c13b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:20.051743 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-651f3540-7f90-4c12-93d5-cff780a6c13b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:20.283363 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-551ee8c2-75b5-4e90-ab15-7c05e8cb39e7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:20.293116 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-551ee8c2-75b5-4e90-ab15-7c05e8cb39e7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f" status: 200 len: 1318 microversion: 2.1 time: 0.331098 Apr 20 18:33:20.303893 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 107/226] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:19 2021] GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:20.309769 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4eb25996-16b8-4527-aadf-bcae8dd24ea0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:20.310683 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4eb25996-16b8-4527-aadf-bcae8dd24ea0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:20.318950 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4eb25996-16b8-4527-aadf-bcae8dd24ea0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:20.319854 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4eb25996-16b8-4527-aadf-bcae8dd24ea0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:20.320989 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4eb25996-16b8-4527-aadf-bcae8dd24ea0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:20.323067 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4eb25996-16b8-4527-aadf-bcae8dd24ea0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:20.600646 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4eb25996-16b8-4527-aadf-bcae8dd24ea0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:20.612179 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4eb25996-16b8-4527-aadf-bcae8dd24ea0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.306643 Apr 20 18:33:20.612917 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 108/227] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:20 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:20.737154 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-651f3540-7f90-4c12-93d5-cff780a6c13b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:20.747339 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-651f3540-7f90-4c12-93d5-cff780a6c13b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 200 len: 1318 microversion: 2.1 time: 0.731112 Apr 20 18:33:20.749815 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 120/228] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:20 2021] GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 1318 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:20.972019 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f0b57e36-bd90-485d-b273-67480cc095d3 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:20.973928 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f0b57e36-bd90-485d-b273-67480cc095d3 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:20.985852 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f0b57e36-bd90-485d-b273-67480cc095d3 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:20.986726 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f0b57e36-bd90-485d-b273-67480cc095d3 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:20.987788 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f0b57e36-bd90-485d-b273-67480cc095d3 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:20.988594 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f0b57e36-bd90-485d-b273-67480cc095d3 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:21.026413 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c00fecd5-4d4e-4eea-86b6-2b2b137ba6a3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:21.028218 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c00fecd5-4d4e-4eea-86b6-2b2b137ba6a3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:21.062827 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c00fecd5-4d4e-4eea-86b6-2b2b137ba6a3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:21.063337 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c00fecd5-4d4e-4eea-86b6-2b2b137ba6a3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:21.064196 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c00fecd5-4d4e-4eea-86b6-2b2b137ba6a3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:21.074587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c00fecd5-4d4e-4eea-86b6-2b2b137ba6a3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:21.245714 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f0b57e36-bd90-485d-b273-67480cc095d3 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 28216 microversion: 2.1 time: 0.279575 Apr 20 18:33:21.246715 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 109/229] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:20 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 28216 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:21.311946 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f8f5d552-0500-4ce6-9269-96e4624a629c tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:21.312720 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f8f5d552-0500-4ce6-9269-96e4624a629c tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:21.331852 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f8f5d552-0500-4ce6-9269-96e4624a629c tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:21.332424 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f8f5d552-0500-4ce6-9269-96e4624a629c tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:21.333329 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f8f5d552-0500-4ce6-9269-96e4624a629c tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:21.337412 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f8f5d552-0500-4ce6-9269-96e4624a629c tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:21.386938 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c00fecd5-4d4e-4eea-86b6-2b2b137ba6a3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 24339 microversion: 2.20 time: 0.353873 Apr 20 18:33:21.396710 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 121/230] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:21 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 24339 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:21.632331 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-c8ce1ded-bbdf-40ac-a398-567fa26ad539 req-aaab77c5-6284-4dfb-9061-cfae352adc76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcbd1381-0624-4c44-8ad1-a058cf37eb89", "tag": "4800bd55-987f-4f15-ad9f-8ef10a6a45b7"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:21.634963 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:33:21.634963 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:33:21.657727 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-c8ce1ded-bbdf-40ac-a398-567fa26ad539 req-aaab77c5-6284-4dfb-9061-cfae352adc76 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:21.659273 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-c8ce1ded-bbdf-40ac-a398-567fa26ad539 req-aaab77c5-6284-4dfb-9061-cfae352adc76 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:21.703265 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-c8ce1ded-bbdf-40ac-a398-567fa26ad539 req-aaab77c5-6284-4dfb-9061-cfae352adc76 service nova] Creating event network-changed:4800bd55-987f-4f15-ad9f-8ef10a6a45b7 for instance dcbd1381-0624-4c44-8ad1-a058cf37eb89 on hv-cinder-78693 Apr 20 18:33:21.714872 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-c8ce1ded-bbdf-40ac-a398-567fa26ad539 req-aaab77c5-6284-4dfb-9061-cfae352adc76 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088109 Apr 20 18:33:21.716420 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 122/231] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:33:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:33:21.723346 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f5308061-c1de-4fc0-a4fb-60dff2964862 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:21.724438 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f5308061-c1de-4fc0-a4fb-60dff2964862 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:21.734984 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f5308061-c1de-4fc0-a4fb-60dff2964862 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:21.735822 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f5308061-c1de-4fc0-a4fb-60dff2964862 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:21.736934 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f5308061-c1de-4fc0-a4fb-60dff2964862 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:21.737711 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f5308061-c1de-4fc0-a4fb-60dff2964862 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:21.973182 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f8f5d552-0500-4ce6-9269-96e4624a629c tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:21.990055 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f8f5d552-0500-4ce6-9269-96e4624a629c tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f" status: 200 len: 1318 microversion: 2.1 time: 0.682495 Apr 20 18:33:21.991049 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 110/232] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:21 2021] GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f => generated 1318 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:33:22.007429 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0d6741dc-1445-449d-8b68-3de48d3f503a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:22.008593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0d6741dc-1445-449d-8b68-3de48d3f503a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:22.019296 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0d6741dc-1445-449d-8b68-3de48d3f503a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:22.020231 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0d6741dc-1445-449d-8b68-3de48d3f503a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:22.021315 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0d6741dc-1445-449d-8b68-3de48d3f503a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:22.022050 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0d6741dc-1445-449d-8b68-3de48d3f503a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:22.262668 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0d6741dc-1445-449d-8b68-3de48d3f503a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:22.272693 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0d6741dc-1445-449d-8b68-3de48d3f503a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 200 len: 1318 microversion: 2.1 time: 0.280224 Apr 20 18:33:22.273747 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 111/233] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:21 2021] GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:22.279632 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1f50ce4c-a248-4696-9367-f0d4331a53a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:22.281355 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1f50ce4c-a248-4696-9367-f0d4331a53a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:22.283474 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f5308061-c1de-4fc0-a4fb-60dff2964862 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:22.289822 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1f50ce4c-a248-4696-9367-f0d4331a53a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:22.291033 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1f50ce4c-a248-4696-9367-f0d4331a53a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:22.292281 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1f50ce4c-a248-4696-9367-f0d4331a53a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:22.292880 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1f50ce4c-a248-4696-9367-f0d4331a53a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:22.294063 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f5308061-c1de-4fc0-a4fb-60dff2964862 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.575564 Apr 20 18:33:22.294908 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 123/234] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:21 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:22.404977 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0d56069e-3d7c-4d5f-aee6-0177e4aaed7d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:22.406287 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0d56069e-3d7c-4d5f-aee6-0177e4aaed7d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:22.414288 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0d56069e-3d7c-4d5f-aee6-0177e4aaed7d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:22.415315 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0d56069e-3d7c-4d5f-aee6-0177e4aaed7d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:22.416453 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0d56069e-3d7c-4d5f-aee6-0177e4aaed7d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:22.417129 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0d56069e-3d7c-4d5f-aee6-0177e4aaed7d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:24.847515 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1f50ce4c-a248-4696-9367-f0d4331a53a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 28216 microversion: 2.1 time: 2.571021 Apr 20 18:33:24.852454 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 112/235] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:22 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 28216 bytes in 2574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:24.874889 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-619301c6-7343-4f1b-ba6b-94139051cbc4 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:24.876639 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-619301c6-7343-4f1b-ba6b-94139051cbc4 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:24.891048 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0d56069e-3d7c-4d5f-aee6-0177e4aaed7d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 26801 microversion: 2.20 time: 2.489513 Apr 20 18:33:24.895707 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 124/236] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:22 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 26801 bytes in 2492 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:33:24.896412 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-619301c6-7343-4f1b-ba6b-94139051cbc4 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:24.897598 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-619301c6-7343-4f1b-ba6b-94139051cbc4 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:24.900884 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-619301c6-7343-4f1b-ba6b-94139051cbc4 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:24.902077 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-619301c6-7343-4f1b-ba6b-94139051cbc4 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:24.915899 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-73174b57-271d-4073-b519-90002ec01d93 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:24.917293 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-73174b57-271d-4073-b519-90002ec01d93 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:24.943598 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-73174b57-271d-4073-b519-90002ec01d93 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:24.944914 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-73174b57-271d-4073-b519-90002ec01d93 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:24.947484 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-73174b57-271d-4073-b519-90002ec01d93 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:24.948542 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-73174b57-271d-4073-b519-90002ec01d93 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:25.471998 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-73174b57-271d-4073-b519-90002ec01d93 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:25.476024 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-619301c6-7343-4f1b-ba6b-94139051cbc4 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:25.485350 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-73174b57-271d-4073-b519-90002ec01d93 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 200 len: 1318 microversion: 2.1 time: 0.590837 Apr 20 18:33:25.497086 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 125/237] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:24 2021] GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 1318 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:25.505532 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-24250ecd-26a7-4773-b869-7485cf84e043 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:25.506962 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-24250ecd-26a7-4773-b869-7485cf84e043 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:25.510987 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-619301c6-7343-4f1b-ba6b-94139051cbc4 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f" status: 200 len: 1318 microversion: 2.1 time: 0.659988 Apr 20 18:33:25.513762 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 113/238] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:24 2021] GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f => generated 1318 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:25.524692 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-24250ecd-26a7-4773-b869-7485cf84e043 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:25.524692 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-24250ecd-26a7-4773-b869-7485cf84e043 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:25.524692 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-24250ecd-26a7-4773-b869-7485cf84e043 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:25.525946 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-24250ecd-26a7-4773-b869-7485cf84e043 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:25.835428 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-24250ecd-26a7-4773-b869-7485cf84e043 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:25.845318 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-24250ecd-26a7-4773-b869-7485cf84e043 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.346638 Apr 20 18:33:25.853870 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 126/239] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:25 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:25.863990 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-00efa72c-5d94-42cf-95d2-d10b2da5b218 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:25.866261 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-00efa72c-5d94-42cf-95d2-d10b2da5b218 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:25.878146 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-00efa72c-5d94-42cf-95d2-d10b2da5b218 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:25.879130 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-00efa72c-5d94-42cf-95d2-d10b2da5b218 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:25.881514 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-00efa72c-5d94-42cf-95d2-d10b2da5b218 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:25.882575 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-00efa72c-5d94-42cf-95d2-d10b2da5b218 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:25.905137 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-045212aa-2bb2-446d-bc26-852844e94c10 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:25.907389 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-045212aa-2bb2-446d-bc26-852844e94c10 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:25.926087 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-045212aa-2bb2-446d-bc26-852844e94c10 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:25.932032 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-045212aa-2bb2-446d-bc26-852844e94c10 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:25.933342 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-045212aa-2bb2-446d-bc26-852844e94c10 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:25.935185 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-045212aa-2bb2-446d-bc26-852844e94c10 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:26.165434 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-00efa72c-5d94-42cf-95d2-d10b2da5b218 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 28216 microversion: 2.1 time: 0.307188 Apr 20 18:33:26.167559 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 114/240] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:25 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 28216 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:26.205466 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-045212aa-2bb2-446d-bc26-852844e94c10 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 27298 microversion: 2.20 time: 0.302356 Apr 20 18:33:26.206696 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 127/241] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:25 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 27298 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:26.510844 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c1b1bcd3-ae97-45b1-80ea-cf70486d34ab tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:26.512270 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c1b1bcd3-ae97-45b1-80ea-cf70486d34ab tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:26.539611 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2c6e1b12-4810-4d92-b525-675b93ebe8aa tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:26.550594 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2c6e1b12-4810-4d92-b525-675b93ebe8aa tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:26.553759 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c1b1bcd3-ae97-45b1-80ea-cf70486d34ab tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:26.561729 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c1b1bcd3-ae97-45b1-80ea-cf70486d34ab tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:26.563503 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c1b1bcd3-ae97-45b1-80ea-cf70486d34ab tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:26.572739 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c1b1bcd3-ae97-45b1-80ea-cf70486d34ab tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:26.597947 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2c6e1b12-4810-4d92-b525-675b93ebe8aa tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:26.608720 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2c6e1b12-4810-4d92-b525-675b93ebe8aa tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:26.610548 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2c6e1b12-4810-4d92-b525-675b93ebe8aa tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:26.611413 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2c6e1b12-4810-4d92-b525-675b93ebe8aa tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:26.974863 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c1b1bcd3-ae97-45b1-80ea-cf70486d34ab tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:26.986221 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c1b1bcd3-ae97-45b1-80ea-cf70486d34ab tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 200 len: 1318 microversion: 2.1 time: 0.483911 Apr 20 18:33:26.998233 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 115/242] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:26 2021] GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:27.005206 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-ecda56e8-b7c1-4ab1-9db2-9252e9713802 req-d3e78072-dfd0-4f04-9cf2-6590d5503cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec63aa76-1efa-45ed-8e4d-89794690776f", "name": "network-vif-plugged", "status": "completed", "tag": "06a72144-d46d-42ad-aef8-3b655cd2b4c6"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:27.007255 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:33:27.007255 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:33:27.017076 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-ecda56e8-b7c1-4ab1-9db2-9252e9713802 req-d3e78072-dfd0-4f04-9cf2-6590d5503cd0 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:27.017639 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-ecda56e8-b7c1-4ab1-9db2-9252e9713802 req-d3e78072-dfd0-4f04-9cf2-6590d5503cd0 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:27.041332 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-ecda56e8-b7c1-4ab1-9db2-9252e9713802 req-d3e78072-dfd0-4f04-9cf2-6590d5503cd0 service nova] Creating event network-vif-plugged:06a72144-d46d-42ad-aef8-3b655cd2b4c6 for instance ec63aa76-1efa-45ed-8e4d-89794690776f on hv-cinder-78693 Apr 20 18:33:27.046943 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-ecda56e8-b7c1-4ab1-9db2-9252e9713802 req-d3e78072-dfd0-4f04-9cf2-6590d5503cd0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046884 Apr 20 18:33:27.047797 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 116/243] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:33:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:33:27.053941 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-eee4a92f-080a-42ec-aad6-57c637b0ccfb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:27.055243 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-eee4a92f-080a-42ec-aad6-57c637b0ccfb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:27.065307 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eee4a92f-080a-42ec-aad6-57c637b0ccfb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:27.065587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eee4a92f-080a-42ec-aad6-57c637b0ccfb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:27.066349 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eee4a92f-080a-42ec-aad6-57c637b0ccfb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:27.066942 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eee4a92f-080a-42ec-aad6-57c637b0ccfb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:27.103274 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2c6e1b12-4810-4d92-b525-675b93ebe8aa tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:27.113541 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2c6e1b12-4810-4d92-b525-675b93ebe8aa tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f" status: 200 len: 1318 microversion: 2.1 time: 0.583251 Apr 20 18:33:27.113958 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 128/244] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:26 2021] GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f => generated 1318 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:27.180005 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-884e87f8-073a-4025-9ba5-b0938f0e4c93 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:27.181932 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-884e87f8-073a-4025-9ba5-b0938f0e4c93 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:27.190682 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-884e87f8-073a-4025-9ba5-b0938f0e4c93 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:27.191500 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-884e87f8-073a-4025-9ba5-b0938f0e4c93 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:27.192352 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-884e87f8-073a-4025-9ba5-b0938f0e4c93 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:27.192931 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-884e87f8-073a-4025-9ba5-b0938f0e4c93 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:27.418065 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-eee4a92f-080a-42ec-aad6-57c637b0ccfb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:27.428078 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-eee4a92f-080a-42ec-aad6-57c637b0ccfb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.379048 Apr 20 18:33:27.428732 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 117/245] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:27 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:27.434759 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-18ba03ea-2f34-4da9-af63-19b6970c3ff6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:27.435907 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-18ba03ea-2f34-4da9-af63-19b6970c3ff6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:27.447152 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-18ba03ea-2f34-4da9-af63-19b6970c3ff6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:27.447805 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-18ba03ea-2f34-4da9-af63-19b6970c3ff6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:27.448675 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-18ba03ea-2f34-4da9-af63-19b6970c3ff6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:27.449186 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-18ba03ea-2f34-4da9-af63-19b6970c3ff6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:29.610312 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-18ba03ea-2f34-4da9-af63-19b6970c3ff6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 27889 microversion: 2.20 time: 2.179351 Apr 20 18:33:29.611780 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 118/246] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:27 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 27889 bytes in 2182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:29.619884 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f7677b18-1f09-43e9-a621-7e5b6a0c5a42 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:29.621042 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f7677b18-1f09-43e9-a621-7e5b6a0c5a42 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:29.635324 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f7677b18-1f09-43e9-a621-7e5b6a0c5a42 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:29.636395 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f7677b18-1f09-43e9-a621-7e5b6a0c5a42 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:29.638945 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f7677b18-1f09-43e9-a621-7e5b6a0c5a42 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:29.639974 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f7677b18-1f09-43e9-a621-7e5b6a0c5a42 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:29.654769 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-884e87f8-073a-4025-9ba5-b0938f0e4c93 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 28216 microversion: 2.1 time: 2.478858 Apr 20 18:33:29.656394 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 129/247] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:27 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 28216 bytes in 2482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:33:29.666498 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-30cb03ce-6f62-4ac6-abde-3593ed491da8 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:29.668061 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-30cb03ce-6f62-4ac6-abde-3593ed491da8 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:29.693380 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-30cb03ce-6f62-4ac6-abde-3593ed491da8 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:29.694374 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-30cb03ce-6f62-4ac6-abde-3593ed491da8 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:29.696730 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-30cb03ce-6f62-4ac6-abde-3593ed491da8 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:29.699939 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-30cb03ce-6f62-4ac6-abde-3593ed491da8 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:30.105113 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f7677b18-1f09-43e9-a621-7e5b6a0c5a42 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:30.130861 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f7677b18-1f09-43e9-a621-7e5b6a0c5a42 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 200 len: 1318 microversion: 2.1 time: 0.517057 Apr 20 18:33:30.132127 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 119/248] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:29 2021] GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 1318 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:30.139400 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-20eca9b5-3c11-4148-a771-2c5455a77ab8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:30.140497 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-20eca9b5-3c11-4148-a771-2c5455a77ab8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:30.150945 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-20eca9b5-3c11-4148-a771-2c5455a77ab8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:30.152029 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-20eca9b5-3c11-4148-a771-2c5455a77ab8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:30.153206 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-20eca9b5-3c11-4148-a771-2c5455a77ab8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:30.153914 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-20eca9b5-3c11-4148-a771-2c5455a77ab8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:30.359668 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-30cb03ce-6f62-4ac6-abde-3593ed491da8 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:30.386431 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-30cb03ce-6f62-4ac6-abde-3593ed491da8 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f" status: 200 len: 1318 microversion: 2.1 time: 0.727726 Apr 20 18:33:30.387955 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 130/249] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:29 2021] GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f => generated 1318 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:30.463518 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-20eca9b5-3c11-4148-a771-2c5455a77ab8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:30.473299 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-20eca9b5-3c11-4148-a771-2c5455a77ab8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.339636 Apr 20 18:33:30.473996 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 120/250] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:30 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:30.627257 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b7dcd845-94d1-4405-8c50-f8c761d90ae9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:30.628473 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b7dcd845-94d1-4405-8c50-f8c761d90ae9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:30.650051 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b7dcd845-94d1-4405-8c50-f8c761d90ae9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:30.650462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b7dcd845-94d1-4405-8c50-f8c761d90ae9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:30.651560 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b7dcd845-94d1-4405-8c50-f8c761d90ae9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:30.652054 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b7dcd845-94d1-4405-8c50-f8c761d90ae9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:30.671202 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1152452f-2b91-4e3a-a0af-5053e58d18a5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:30.673070 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1152452f-2b91-4e3a-a0af-5053e58d18a5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:30.684833 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1152452f-2b91-4e3a-a0af-5053e58d18a5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:30.685832 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1152452f-2b91-4e3a-a0af-5053e58d18a5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:30.687005 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1152452f-2b91-4e3a-a0af-5053e58d18a5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:30.687886 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1152452f-2b91-4e3a-a0af-5053e58d18a5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:30.852658 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b7dcd845-94d1-4405-8c50-f8c761d90ae9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 28179 microversion: 2.20 time: 0.228828 Apr 20 18:33:30.853833 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 131/251] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:30 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 28179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:30.886897 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1152452f-2b91-4e3a-a0af-5053e58d18a5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 28460 microversion: 2.1 time: 0.220556 Apr 20 18:33:30.888588 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 121/252] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:30 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 28460 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:33:31.169923 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3c20f2d8-e805-441f-9aaf-754bc828ec90 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:31.171588 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3c20f2d8-e805-441f-9aaf-754bc828ec90 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:31.190309 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c20f2d8-e805-441f-9aaf-754bc828ec90 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:31.191661 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c20f2d8-e805-441f-9aaf-754bc828ec90 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:31.193352 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c20f2d8-e805-441f-9aaf-754bc828ec90 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:31.194974 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c20f2d8-e805-441f-9aaf-754bc828ec90 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:31.421298 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-67e8f9a7-c3f2-4369-8c83-3016353d759b tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:31.422107 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-67e8f9a7-c3f2-4369-8c83-3016353d759b tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:31.445627 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-67e8f9a7-c3f2-4369-8c83-3016353d759b tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:31.447422 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-67e8f9a7-c3f2-4369-8c83-3016353d759b tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:31.452887 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-67e8f9a7-c3f2-4369-8c83-3016353d759b tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:31.453518 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-67e8f9a7-c3f2-4369-8c83-3016353d759b tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:31.515342 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3c20f2d8-e805-441f-9aaf-754bc828ec90 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:31.526270 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3c20f2d8-e805-441f-9aaf-754bc828ec90 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 200 len: 1318 microversion: 2.1 time: 0.370174 Apr 20 18:33:31.527256 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 132/253] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:31 2021] GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:31.561028 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-23d5cdc1-e1c3-44ed-8f54-200cf3b58291 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:31.564468 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-23d5cdc1-e1c3-44ed-8f54-200cf3b58291 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:31.581002 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-23d5cdc1-e1c3-44ed-8f54-200cf3b58291 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:31.582110 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-23d5cdc1-e1c3-44ed-8f54-200cf3b58291 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:31.583542 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-23d5cdc1-e1c3-44ed-8f54-200cf3b58291 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:31.584202 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-23d5cdc1-e1c3-44ed-8f54-200cf3b58291 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:31.757775 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-67e8f9a7-c3f2-4369-8c83-3016353d759b tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:31.768381 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-67e8f9a7-c3f2-4369-8c83-3016353d759b tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f" status: 200 len: 1318 microversion: 2.1 time: 0.352279 Apr 20 18:33:31.769126 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 122/254] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:31 2021] GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:31.841901 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-23d5cdc1-e1c3-44ed-8f54-200cf3b58291 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:31.851334 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-23d5cdc1-e1c3-44ed-8f54-200cf3b58291 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.301458 Apr 20 18:33:31.852059 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 133/255] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:31 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:31.866618 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b015a780-3341-4174-b5d0-a6f3042dd2bb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:31.868365 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b015a780-3341-4174-b5d0-a6f3042dd2bb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:31.879294 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b015a780-3341-4174-b5d0-a6f3042dd2bb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:31.879509 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b015a780-3341-4174-b5d0-a6f3042dd2bb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:31.880331 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b015a780-3341-4174-b5d0-a6f3042dd2bb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:31.880832 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b015a780-3341-4174-b5d0-a6f3042dd2bb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:31.900572 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-49a92837-6cba-454a-b0b0-a5b646c350a0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:31.901503 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-49a92837-6cba-454a-b0b0-a5b646c350a0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:31.910206 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-49a92837-6cba-454a-b0b0-a5b646c350a0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:31.910720 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-49a92837-6cba-454a-b0b0-a5b646c350a0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:31.911587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-49a92837-6cba-454a-b0b0-a5b646c350a0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:31.912083 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-49a92837-6cba-454a-b0b0-a5b646c350a0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:32.075809 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b015a780-3341-4174-b5d0-a6f3042dd2bb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 28179 microversion: 2.20 time: 0.212938 Apr 20 18:33:32.076633 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 123/256] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:31 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 28179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:32.137713 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-49a92837-6cba-454a-b0b0-a5b646c350a0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 28505 microversion: 2.1 time: 0.241738 Apr 20 18:33:32.138469 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 134/257] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:31 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 28505 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:32.546688 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c37abe06-4652-40f4-ad99-c9f7359fec1f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:32.547474 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c37abe06-4652-40f4-ad99-c9f7359fec1f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:32.557773 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c37abe06-4652-40f4-ad99-c9f7359fec1f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:32.558283 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c37abe06-4652-40f4-ad99-c9f7359fec1f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:32.559139 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c37abe06-4652-40f4-ad99-c9f7359fec1f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:32.559638 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c37abe06-4652-40f4-ad99-c9f7359fec1f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:32.795646 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-46f14977-cf90-41ab-bf7f-11bc68340076 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:32.797195 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-46f14977-cf90-41ab-bf7f-11bc68340076 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:32.808202 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-46f14977-cf90-41ab-bf7f-11bc68340076 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:32.809019 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-46f14977-cf90-41ab-bf7f-11bc68340076 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:32.810193 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-46f14977-cf90-41ab-bf7f-11bc68340076 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:32.810861 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-46f14977-cf90-41ab-bf7f-11bc68340076 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:32.824583 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c37abe06-4652-40f4-ad99-c9f7359fec1f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:32.836846 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c37abe06-4652-40f4-ad99-c9f7359fec1f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 200 len: 1318 microversion: 2.1 time: 0.294584 Apr 20 18:33:32.838179 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 124/258] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:32 2021] GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:32.873284 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-440ae286-3e79-4a88-b5c5-58b26b2b0ef3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:32.874023 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-440ae286-3e79-4a88-b5c5-58b26b2b0ef3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:32.883283 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-440ae286-3e79-4a88-b5c5-58b26b2b0ef3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:32.883940 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-440ae286-3e79-4a88-b5c5-58b26b2b0ef3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:32.885626 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-440ae286-3e79-4a88-b5c5-58b26b2b0ef3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:32.886149 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-440ae286-3e79-4a88-b5c5-58b26b2b0ef3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:33.112509 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-46f14977-cf90-41ab-bf7f-11bc68340076 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:33.127294 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-46f14977-cf90-41ab-bf7f-11bc68340076 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f" status: 200 len: 1507 microversion: 2.1 time: 0.335630 Apr 20 18:33:33.130230 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 135/259] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:32 2021] GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f => generated 1507 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:33.136719 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f7b94649-8063-4247-97e6-7e61c0c2635c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:33.137806 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f7b94649-8063-4247-97e6-7e61c0c2635c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:33.149694 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f7b94649-8063-4247-97e6-7e61c0c2635c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:33.150973 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f7b94649-8063-4247-97e6-7e61c0c2635c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:33.152637 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f7b94649-8063-4247-97e6-7e61c0c2635c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:33.154445 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f7b94649-8063-4247-97e6-7e61c0c2635c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:33.163710 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-440ae286-3e79-4a88-b5c5-58b26b2b0ef3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:33.173730 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-440ae286-3e79-4a88-b5c5-58b26b2b0ef3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.304795 Apr 20 18:33:33.174574 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 125/260] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:32 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:33.184661 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c904c21e-0417-4cd4-8c9f-71fa8d2fb4c5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:33.186986 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c904c21e-0417-4cd4-8c9f-71fa8d2fb4c5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:33.204412 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c904c21e-0417-4cd4-8c9f-71fa8d2fb4c5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:33.205213 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c904c21e-0417-4cd4-8c9f-71fa8d2fb4c5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:33.206784 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c904c21e-0417-4cd4-8c9f-71fa8d2fb4c5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:33.207676 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c904c21e-0417-4cd4-8c9f-71fa8d2fb4c5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:34.993983 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c904c21e-0417-4cd4-8c9f-71fa8d2fb4c5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 28505 microversion: 2.1 time: 1.818066 Apr 20 18:33:34.998155 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 126/261] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:33 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 28505 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:35.001088 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3474cf29-5907-44ba-9027-137a69a5ba84 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:35.001906 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3474cf29-5907-44ba-9027-137a69a5ba84 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:35.010782 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3474cf29-5907-44ba-9027-137a69a5ba84 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:35.011288 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3474cf29-5907-44ba-9027-137a69a5ba84 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:35.012137 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3474cf29-5907-44ba-9027-137a69a5ba84 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:35.012626 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3474cf29-5907-44ba-9027-137a69a5ba84 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:35.017639 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f7b94649-8063-4247-97e6-7e61c0c2635c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 28179 microversion: 2.20 time: 1.885601 Apr 20 18:33:35.018354 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 136/262] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:33 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 28179 bytes in 1887 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:35.025705 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-dbf998b2-8070-40f5-8772-da8a164be6ee req-ebc4b257-bac9-41a3-989f-ea9bb0e5ae4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcbd1381-0624-4c44-8ad1-a058cf37eb89", "name": "network-vif-plugged", "status": "completed", "tag": "4800bd55-987f-4f15-ad9f-8ef10a6a45b7"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:35.027457 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:33:35.027457 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:33:35.037602 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-dbf998b2-8070-40f5-8772-da8a164be6ee req-ebc4b257-bac9-41a3-989f-ea9bb0e5ae4e service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:35.038113 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-dbf998b2-8070-40f5-8772-da8a164be6ee req-ebc4b257-bac9-41a3-989f-ea9bb0e5ae4e service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:35.057181 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-dbf998b2-8070-40f5-8772-da8a164be6ee req-ebc4b257-bac9-41a3-989f-ea9bb0e5ae4e service nova] Creating event network-vif-plugged:4800bd55-987f-4f15-ad9f-8ef10a6a45b7 for instance dcbd1381-0624-4c44-8ad1-a058cf37eb89 on hv-cinder-78693 Apr 20 18:33:35.062919 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-dbf998b2-8070-40f5-8772-da8a164be6ee req-ebc4b257-bac9-41a3-989f-ea9bb0e5ae4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042773 Apr 20 18:33:35.063601 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 137/263] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:33:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:33:35.069149 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b3d24a6f-c71c-440a-8f4c-4f485e1b26c1 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:35.069967 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b3d24a6f-c71c-440a-8f4c-4f485e1b26c1 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:35.080332 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b3d24a6f-c71c-440a-8f4c-4f485e1b26c1 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:35.081225 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b3d24a6f-c71c-440a-8f4c-4f485e1b26c1 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:35.082340 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b3d24a6f-c71c-440a-8f4c-4f485e1b26c1 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:35.083055 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b3d24a6f-c71c-440a-8f4c-4f485e1b26c1 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:35.310122 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3474cf29-5907-44ba-9027-137a69a5ba84 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:35.319889 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3474cf29-5907-44ba-9027-137a69a5ba84 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 200 len: 1318 microversion: 2.1 time: 0.323826 Apr 20 18:33:35.322068 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 127/264] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:34 2021] GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:35.382015 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b3d24a6f-c71c-440a-8f4c-4f485e1b26c1 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:35.412844 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b3d24a6f-c71c-440a-8f4c-4f485e1b26c1 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.347910 Apr 20 18:33:35.413693 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 138/265] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:35 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:36.010798 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-300d9c31-8e60-45d5-b219-795b4d9400de tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:36.012024 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-300d9c31-8e60-45d5-b219-795b4d9400de tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:36.021986 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-300d9c31-8e60-45d5-b219-795b4d9400de tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:36.022832 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-300d9c31-8e60-45d5-b219-795b4d9400de tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:36.023822 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-300d9c31-8e60-45d5-b219-795b4d9400de tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:36.024726 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-300d9c31-8e60-45d5-b219-795b4d9400de tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:36.041197 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1a113200-436f-4ac0-b65c-b2fb18b008fd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:36.043142 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1a113200-436f-4ac0-b65c-b2fb18b008fd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:36.063043 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1a113200-436f-4ac0-b65c-b2fb18b008fd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:36.063916 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1a113200-436f-4ac0-b65c-b2fb18b008fd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:36.064973 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1a113200-436f-4ac0-b65c-b2fb18b008fd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:36.065723 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1a113200-436f-4ac0-b65c-b2fb18b008fd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:36.239362 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-300d9c31-8e60-45d5-b219-795b4d9400de tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 28673 microversion: 2.1 time: 0.234242 Apr 20 18:33:36.240582 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 128/266] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:36 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 28673 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:36.304134 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1a113200-436f-4ac0-b65c-b2fb18b008fd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 28179 microversion: 2.20 time: 0.271503 Apr 20 18:33:36.306235 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 139/267] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:36 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 28179 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:36.340364 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-63b10dda-686b-4d8c-8b05-9eb75cfae48c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:36.341152 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-63b10dda-686b-4d8c-8b05-9eb75cfae48c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:36.361882 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-63b10dda-686b-4d8c-8b05-9eb75cfae48c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:36.362444 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-63b10dda-686b-4d8c-8b05-9eb75cfae48c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:36.363384 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-63b10dda-686b-4d8c-8b05-9eb75cfae48c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:36.363882 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-63b10dda-686b-4d8c-8b05-9eb75cfae48c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:36.440081 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5a0d3a9a-6999-4700-80af-f7b8276f8c5e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:36.446558 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5a0d3a9a-6999-4700-80af-f7b8276f8c5e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:36.471358 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a0d3a9a-6999-4700-80af-f7b8276f8c5e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:36.472121 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a0d3a9a-6999-4700-80af-f7b8276f8c5e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:36.473303 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a0d3a9a-6999-4700-80af-f7b8276f8c5e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:36.473977 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a0d3a9a-6999-4700-80af-f7b8276f8c5e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:36.641863 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-63b10dda-686b-4d8c-8b05-9eb75cfae48c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:36.652652 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-63b10dda-686b-4d8c-8b05-9eb75cfae48c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 200 len: 1318 microversion: 2.1 time: 0.317593 Apr 20 18:33:36.655269 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 129/268] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:36 2021] GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:36.744496 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5a0d3a9a-6999-4700-80af-f7b8276f8c5e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:36.758704 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5a0d3a9a-6999-4700-80af-f7b8276f8c5e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.325114 Apr 20 18:33:36.766681 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 140/269] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:36 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:33:37.256332 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b2b16265-397d-4739-9e3e-86c278ec7eaf tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:37.257784 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b2b16265-397d-4739-9e3e-86c278ec7eaf tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:37.276856 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b2b16265-397d-4739-9e3e-86c278ec7eaf tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:37.280130 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b2b16265-397d-4739-9e3e-86c278ec7eaf tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:37.282664 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b2b16265-397d-4739-9e3e-86c278ec7eaf tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:37.283603 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b2b16265-397d-4739-9e3e-86c278ec7eaf tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:37.324807 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-32ebf679-d1a0-4f7b-9c01-852eb6419bd9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:37.326303 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-32ebf679-d1a0-4f7b-9c01-852eb6419bd9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:37.335268 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-32ebf679-d1a0-4f7b-9c01-852eb6419bd9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:37.336729 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-32ebf679-d1a0-4f7b-9c01-852eb6419bd9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:37.338771 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-32ebf679-d1a0-4f7b-9c01-852eb6419bd9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:37.339702 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-32ebf679-d1a0-4f7b-9c01-852eb6419bd9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:37.488542 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b2b16265-397d-4739-9e3e-86c278ec7eaf tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 28673 microversion: 2.1 time: 0.239536 Apr 20 18:33:37.490211 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 130/270] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:37 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 28673 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:33:37.622644 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-32ebf679-d1a0-4f7b-9c01-852eb6419bd9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 28469 microversion: 2.20 time: 0.304251 Apr 20 18:33:37.624223 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 141/271] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:37 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 28469 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:33:37.676543 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7b57471d-ee66-4353-96d2-eb9a85455812 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:37.677330 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7b57471d-ee66-4353-96d2-eb9a85455812 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:37.686952 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7b57471d-ee66-4353-96d2-eb9a85455812 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:37.687455 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7b57471d-ee66-4353-96d2-eb9a85455812 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:37.688309 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7b57471d-ee66-4353-96d2-eb9a85455812 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:37.688797 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7b57471d-ee66-4353-96d2-eb9a85455812 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:37.778517 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2e6647c0-b6a8-4fdd-91f3-8d433dc1c450 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:37.779841 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2e6647c0-b6a8-4fdd-91f3-8d433dc1c450 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:37.790403 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2e6647c0-b6a8-4fdd-91f3-8d433dc1c450 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:37.791159 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2e6647c0-b6a8-4fdd-91f3-8d433dc1c450 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:37.792082 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2e6647c0-b6a8-4fdd-91f3-8d433dc1c450 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:37.792670 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2e6647c0-b6a8-4fdd-91f3-8d433dc1c450 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:37.944956 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7b57471d-ee66-4353-96d2-eb9a85455812 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:37.955385 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7b57471d-ee66-4353-96d2-eb9a85455812 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 200 len: 1507 microversion: 2.1 time: 0.284525 Apr 20 18:33:37.956486 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 131/272] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:37 2021] GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 1507 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:38.067870 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2e6647c0-b6a8-4fdd-91f3-8d433dc1c450 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:38.078390 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2e6647c0-b6a8-4fdd-91f3-8d433dc1c450 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.305768 Apr 20 18:33:38.079459 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 142/273] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:37 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:38.504345 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-aab1b74f-fd51-483c-9948-3e98952dfc11 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:38.508966 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-aab1b74f-fd51-483c-9948-3e98952dfc11 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:38.520934 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-aab1b74f-fd51-483c-9948-3e98952dfc11 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:38.522174 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-aab1b74f-fd51-483c-9948-3e98952dfc11 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:38.523094 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-aab1b74f-fd51-483c-9948-3e98952dfc11 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:38.523732 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-aab1b74f-fd51-483c-9948-3e98952dfc11 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:38.637288 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3036c094-69c8-49d8-a123-3cda34e748fd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:38.638385 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3036c094-69c8-49d8-a123-3cda34e748fd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:38.647421 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3036c094-69c8-49d8-a123-3cda34e748fd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:38.647928 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3036c094-69c8-49d8-a123-3cda34e748fd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:38.649328 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3036c094-69c8-49d8-a123-3cda34e748fd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:38.650790 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3036c094-69c8-49d8-a123-3cda34e748fd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:41.079055 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-aab1b74f-fd51-483c-9948-3e98952dfc11 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 28673 microversion: 2.1 time: 2.580880 Apr 20 18:33:41.079834 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 132/274] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:38 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 28673 bytes in 2583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:33:41.085792 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f0e3f309-56b0-421c-bbc7-acf979a81937 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:41.086618 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f0e3f309-56b0-421c-bbc7-acf979a81937 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:41.096247 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f0e3f309-56b0-421c-bbc7-acf979a81937 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:41.096762 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f0e3f309-56b0-421c-bbc7-acf979a81937 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:41.097678 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f0e3f309-56b0-421c-bbc7-acf979a81937 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:41.098182 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f0e3f309-56b0-421c-bbc7-acf979a81937 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:41.111104 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3036c094-69c8-49d8-a123-3cda34e748fd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 28469 microversion: 2.20 time: 2.477513 Apr 20 18:33:41.112594 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 143/275] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:38 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 28469 bytes in 2480 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:33:41.333075 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f0e3f309-56b0-421c-bbc7-acf979a81937 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:41.345640 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f0e3f309-56b0-421c-bbc7-acf979a81937 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1520 microversion: 2.1 time: 0.264185 Apr 20 18:33:41.346063 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 133/276] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:41 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:42.093585 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b35274fc-0d1b-47b3-abbd-1986cfaf8aed tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:42.095078 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b35274fc-0d1b-47b3-abbd-1986cfaf8aed tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:42.106579 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b35274fc-0d1b-47b3-abbd-1986cfaf8aed tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:42.107162 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b35274fc-0d1b-47b3-abbd-1986cfaf8aed tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:42.108108 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b35274fc-0d1b-47b3-abbd-1986cfaf8aed tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:42.108677 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b35274fc-0d1b-47b3-abbd-1986cfaf8aed tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:42.131337 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-22175fa4-6612-4bd7-abce-fc59907956cc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:42.134066 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-22175fa4-6612-4bd7-abce-fc59907956cc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:42.152250 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-22175fa4-6612-4bd7-abce-fc59907956cc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:42.153439 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-22175fa4-6612-4bd7-abce-fc59907956cc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:42.155129 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-22175fa4-6612-4bd7-abce-fc59907956cc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:42.156163 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-22175fa4-6612-4bd7-abce-fc59907956cc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:42.366088 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-22175fa4-6612-4bd7-abce-fc59907956cc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 28636 microversion: 2.20 time: 0.243240 Apr 20 18:33:42.371831 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 134/277] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:42 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 28636 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:33:42.378560 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-714da32f-08d5-480f-bdb4-f77b9a1829b2 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:42.379691 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-714da32f-08d5-480f-bdb4-f77b9a1829b2 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:42.391640 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-714da32f-08d5-480f-bdb4-f77b9a1829b2 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:42.392748 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-714da32f-08d5-480f-bdb4-f77b9a1829b2 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:42.394557 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-714da32f-08d5-480f-bdb4-f77b9a1829b2 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:42.395367 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-714da32f-08d5-480f-bdb4-f77b9a1829b2 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:42.402200 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b35274fc-0d1b-47b3-abbd-1986cfaf8aed tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 28673 microversion: 2.1 time: 0.313668 Apr 20 18:33:42.404026 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 144/278] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:42 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 28673 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:42.701601 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-714da32f-08d5-480f-bdb4-f77b9a1829b2 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:42.713833 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-714da32f-08d5-480f-bdb4-f77b9a1829b2 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1500 microversion: 2.1 time: 0.340106 Apr 20 18:33:42.714711 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 135/279] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:42 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1500 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:42.746051 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6298a204-4f9b-49ef-85c0-946f7d99cc9b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:42.746854 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6298a204-4f9b-49ef-85c0-946f7d99cc9b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:42.757410 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6298a204-4f9b-49ef-85c0-946f7d99cc9b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:42.758488 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6298a204-4f9b-49ef-85c0-946f7d99cc9b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:42.760395 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6298a204-4f9b-49ef-85c0-946f7d99cc9b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:42.760922 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6298a204-4f9b-49ef-85c0-946f7d99cc9b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:42.944846 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d7678cf4-316b-4b1f-8736-4b686cd33327 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1adbef25-4598-46fd-999e-b0bd22f37858"}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:42.946097 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d7678cf4-316b-4b1f-8736-4b686cd33327 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:42.955156 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d7678cf4-316b-4b1f-8736-4b686cd33327 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:42.958038 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d7678cf4-316b-4b1f-8736-4b686cd33327 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:42.959250 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d7678cf4-316b-4b1f-8736-4b686cd33327 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:42.959882 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d7678cf4-316b-4b1f-8736-4b686cd33327 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:43.044483 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6298a204-4f9b-49ef-85c0-946f7d99cc9b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:43.067889 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6298a204-4f9b-49ef-85c0-946f7d99cc9b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1514 microversion: 2.1 time: 0.328239 Apr 20 18:33:43.068834 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 145/280] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:42 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1514 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:33:43.380704 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-35d92c8a-9084-4424-8292-dd4346e90d1e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:43.382662 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-35d92c8a-9084-4424-8292-dd4346e90d1e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:43.392970 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-35d92c8a-9084-4424-8292-dd4346e90d1e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:43.393742 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-35d92c8a-9084-4424-8292-dd4346e90d1e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:43.394834 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-35d92c8a-9084-4424-8292-dd4346e90d1e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:43.395576 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-35d92c8a-9084-4424-8292-dd4346e90d1e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:43.550051 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d7678cf4-316b-4b1f-8736-4b686cd33327 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "POST /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.609047 Apr 20 18:33:43.556116 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 136/281] 10.222.0.25 () {60 vars in 1313 bytes} [Tue Apr 20 18:33:42 2021] POST /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89/os-volume_attachments => generated 194 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:33:43.557354 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-aee4e072-8eee-4098-92bc-4ae9c84c9753 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:43.559223 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-aee4e072-8eee-4098-92bc-4ae9c84c9753 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:43.571480 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-aee4e072-8eee-4098-92bc-4ae9c84c9753 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:43.572261 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-aee4e072-8eee-4098-92bc-4ae9c84c9753 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:43.573214 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-aee4e072-8eee-4098-92bc-4ae9c84c9753 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:43.573809 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-aee4e072-8eee-4098-92bc-4ae9c84c9753 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:43.584516 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-35d92c8a-9084-4424-8292-dd4346e90d1e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 28636 microversion: 2.20 time: 0.204327 Apr 20 18:33:43.591614 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 146/282] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:43 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 28636 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:33:43.761877 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-aee4e072-8eee-4098-92bc-4ae9c84c9753 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 28673 microversion: 2.1 time: 0.209233 Apr 20 18:33:43.762814 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 137/283] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:43 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 28673 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:44.599189 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-29aa91fd-0c69-4191-bb04-9635e2bf253e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:44.600499 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-29aa91fd-0c69-4191-bb04-9635e2bf253e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:44.612861 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29aa91fd-0c69-4191-bb04-9635e2bf253e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:44.613504 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29aa91fd-0c69-4191-bb04-9635e2bf253e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:44.614488 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29aa91fd-0c69-4191-bb04-9635e2bf253e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:44.615287 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29aa91fd-0c69-4191-bb04-9635e2bf253e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:44.763660 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-29aa91fd-0c69-4191-bb04-9635e2bf253e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 28636 microversion: 2.20 time: 0.169441 Apr 20 18:33:44.765428 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 147/284] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:44 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 28636 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:44.785173 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0847f1f5-04d7-43e1-a16e-2f0a65428dbe tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:44.786527 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0847f1f5-04d7-43e1-a16e-2f0a65428dbe tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:44.796041 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0847f1f5-04d7-43e1-a16e-2f0a65428dbe tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:44.796857 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0847f1f5-04d7-43e1-a16e-2f0a65428dbe tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:44.797846 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0847f1f5-04d7-43e1-a16e-2f0a65428dbe tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:44.798348 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0847f1f5-04d7-43e1-a16e-2f0a65428dbe tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:44.961717 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0847f1f5-04d7-43e1-a16e-2f0a65428dbe tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 28673 microversion: 2.1 time: 0.188225 Apr 20 18:33:44.963038 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 138/285] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:44 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 28673 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:45.046696 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2ff06b11-3f18-47a3-b72a-767d529a6c8c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:45.048152 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2ff06b11-3f18-47a3-b72a-767d529a6c8c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:45.057658 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2ff06b11-3f18-47a3-b72a-767d529a6c8c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:45.058178 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2ff06b11-3f18-47a3-b72a-767d529a6c8c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:45.059042 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2ff06b11-3f18-47a3-b72a-767d529a6c8c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:45.059542 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2ff06b11-3f18-47a3-b72a-767d529a6c8c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:45.127223 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-2ff06b11-3f18-47a3-b72a-767d529a6c8c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lazy-loading 'flavor' on Instance uuid aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d {{(pid=100593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:33:45.289941 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2ff06b11-3f18-47a3-b72a-767d529a6c8c tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "POST /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d/action" status: 200 len: 32 microversion: 2.1 time: 0.247299 Apr 20 18:33:45.291058 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 148/286] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:45 2021] POST /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d/action => generated 32 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:33:45.310039 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-48596bef-a3e9-41dd-9b7d-3762d44f3df3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:45.310836 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-48596bef-a3e9-41dd-9b7d-3762d44f3df3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:45.321423 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-48596bef-a3e9-41dd-9b7d-3762d44f3df3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:45.321952 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-48596bef-a3e9-41dd-9b7d-3762d44f3df3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:45.322960 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-48596bef-a3e9-41dd-9b7d-3762d44f3df3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:45.323322 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-48596bef-a3e9-41dd-9b7d-3762d44f3df3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:45.702842 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-48596bef-a3e9-41dd-9b7d-3762d44f3df3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:45.714371 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-48596bef-a3e9-41dd-9b7d-3762d44f3df3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1520 microversion: 2.1 time: 0.417280 Apr 20 18:33:45.715404 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 139/287] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:45 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1520 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:45.779280 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5c743d23-899b-4c2c-9e48-11e35f3e4538 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:45.781479 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5c743d23-899b-4c2c-9e48-11e35f3e4538 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:45.794765 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5c743d23-899b-4c2c-9e48-11e35f3e4538 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:45.795534 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5c743d23-899b-4c2c-9e48-11e35f3e4538 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:45.798739 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5c743d23-899b-4c2c-9e48-11e35f3e4538 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:45.799857 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5c743d23-899b-4c2c-9e48-11e35f3e4538 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:45.972058 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5c743d23-899b-4c2c-9e48-11e35f3e4538 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 28636 microversion: 2.20 time: 0.198975 Apr 20 18:33:45.972929 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 149/288] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:45 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 28636 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:45.975409 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6ed39aee-b882-4cec-9a6d-df3cf89907c8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:45.977516 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6ed39aee-b882-4cec-9a6d-df3cf89907c8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:45.986438 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6ed39aee-b882-4cec-9a6d-df3cf89907c8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:45.987209 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6ed39aee-b882-4cec-9a6d-df3cf89907c8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:45.988587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6ed39aee-b882-4cec-9a6d-df3cf89907c8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:45.989126 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6ed39aee-b882-4cec-9a6d-df3cf89907c8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:46.192133 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6ed39aee-b882-4cec-9a6d-df3cf89907c8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 29343 microversion: 2.1 time: 0.220690 Apr 20 18:33:46.198024 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 140/289] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:45 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 29343 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:33:46.746457 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-661f6448-cd87-47be-8063-21627c5088aa tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:46.747241 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-661f6448-cd87-47be-8063-21627c5088aa tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:46.764512 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-661f6448-cd87-47be-8063-21627c5088aa tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:46.765842 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-661f6448-cd87-47be-8063-21627c5088aa tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:46.766718 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-661f6448-cd87-47be-8063-21627c5088aa tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:46.767218 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-661f6448-cd87-47be-8063-21627c5088aa tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:46.986597 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-23482a68-8037-4249-84a3-0b66da424e8e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:46.988545 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-23482a68-8037-4249-84a3-0b66da424e8e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:46.999250 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-23482a68-8037-4249-84a3-0b66da424e8e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:46.999965 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-23482a68-8037-4249-84a3-0b66da424e8e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:47.000957 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-23482a68-8037-4249-84a3-0b66da424e8e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:47.001636 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-23482a68-8037-4249-84a3-0b66da424e8e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:47.022108 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-661f6448-cd87-47be-8063-21627c5088aa tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:47.031587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-661f6448-cd87-47be-8063-21627c5088aa tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1520 microversion: 2.1 time: 0.290456 Apr 20 18:33:47.032213 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 150/290] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:46 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:47.161438 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-23482a68-8037-4249-84a3-0b66da424e8e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 28636 microversion: 2.20 time: 0.179038 Apr 20 18:33:47.162812 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 141/291] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:46 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 28636 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:47.206878 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7b9a2125-6573-440d-9327-ca1d26e10be0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:47.208235 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7b9a2125-6573-440d-9327-ca1d26e10be0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:47.225127 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7b9a2125-6573-440d-9327-ca1d26e10be0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:47.225706 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7b9a2125-6573-440d-9327-ca1d26e10be0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:47.227145 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7b9a2125-6573-440d-9327-ca1d26e10be0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:47.227696 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7b9a2125-6573-440d-9327-ca1d26e10be0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:47.388477 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7b9a2125-6573-440d-9327-ca1d26e10be0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 30551 microversion: 2.1 time: 0.185857 Apr 20 18:33:47.392734 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 151/292] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:47 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 30551 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:48.052237 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-79461d8c-928d-4de1-abd4-a29b9d0dde83 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:48.053252 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-79461d8c-928d-4de1-abd4-a29b9d0dde83 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:48.063769 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79461d8c-928d-4de1-abd4-a29b9d0dde83 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:48.063943 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79461d8c-928d-4de1-abd4-a29b9d0dde83 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:48.064921 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79461d8c-928d-4de1-abd4-a29b9d0dde83 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:48.065670 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79461d8c-928d-4de1-abd4-a29b9d0dde83 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:48.175475 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d06a56e7-8af4-4798-b593-2d5b1f8e01c3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:48.176773 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d06a56e7-8af4-4798-b593-2d5b1f8e01c3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:48.186867 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d06a56e7-8af4-4798-b593-2d5b1f8e01c3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:48.187248 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d06a56e7-8af4-4798-b593-2d5b1f8e01c3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:48.188235 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d06a56e7-8af4-4798-b593-2d5b1f8e01c3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:48.188855 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d06a56e7-8af4-4798-b593-2d5b1f8e01c3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:48.327370 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-79461d8c-928d-4de1-abd4-a29b9d0dde83 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:48.337918 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-79461d8c-928d-4de1-abd4-a29b9d0dde83 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1520 microversion: 2.1 time: 0.290282 Apr 20 18:33:48.338786 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 142/293] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:48 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:48.373231 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d06a56e7-8af4-4798-b593-2d5b1f8e01c3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 28636 microversion: 2.20 time: 0.201011 Apr 20 18:33:48.374684 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 152/294] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:48 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 28636 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:48.402640 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f9b5a932-fc12-4d00-afd5-9d728188f321 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:48.404153 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f9b5a932-fc12-4d00-afd5-9d728188f321 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:48.415260 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f9b5a932-fc12-4d00-afd5-9d728188f321 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:48.416153 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f9b5a932-fc12-4d00-afd5-9d728188f321 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:48.417254 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f9b5a932-fc12-4d00-afd5-9d728188f321 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:48.417951 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f9b5a932-fc12-4d00-afd5-9d728188f321 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:48.587608 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f9b5a932-fc12-4d00-afd5-9d728188f321 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 31507 microversion: 2.1 time: 0.190451 Apr 20 18:33:48.588369 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 143/295] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:48 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 31507 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:49.359108 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e141d8fd-e6bb-45d6-9b7b-53b94c6dd7f8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:49.360484 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e141d8fd-e6bb-45d6-9b7b-53b94c6dd7f8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:49.373722 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e141d8fd-e6bb-45d6-9b7b-53b94c6dd7f8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:49.374550 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e141d8fd-e6bb-45d6-9b7b-53b94c6dd7f8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:49.375620 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e141d8fd-e6bb-45d6-9b7b-53b94c6dd7f8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:49.376366 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e141d8fd-e6bb-45d6-9b7b-53b94c6dd7f8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:49.389878 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-bcabc03d-2e41-4445-bb2c-2577b3c426e6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:49.391074 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-bcabc03d-2e41-4445-bb2c-2577b3c426e6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:49.412389 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bcabc03d-2e41-4445-bb2c-2577b3c426e6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:49.413062 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bcabc03d-2e41-4445-bb2c-2577b3c426e6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:49.420865 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bcabc03d-2e41-4445-bb2c-2577b3c426e6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:49.421690 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bcabc03d-2e41-4445-bb2c-2577b3c426e6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:49.635669 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-bcabc03d-2e41-4445-bb2c-2577b3c426e6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 29542 microversion: 2.20 time: 0.253220 Apr 20 18:33:49.637050 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 144/296] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:49 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 29542 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:49.643390 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-bfabdfd4-603c-415a-821e-267899d0f3a4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:49.644816 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-bfabdfd4-603c-415a-821e-267899d0f3a4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:49.655026 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bfabdfd4-603c-415a-821e-267899d0f3a4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:49.655798 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bfabdfd4-603c-415a-821e-267899d0f3a4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:49.656734 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bfabdfd4-603c-415a-821e-267899d0f3a4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:49.657477 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bfabdfd4-603c-415a-821e-267899d0f3a4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:49.693906 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e141d8fd-e6bb-45d6-9b7b-53b94c6dd7f8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:49.711971 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e141d8fd-e6bb-45d6-9b7b-53b94c6dd7f8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1520 microversion: 2.1 time: 0.356896 Apr 20 18:33:49.713751 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 153/297] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:49 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1520 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:49.830287 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-bfabdfd4-603c-415a-821e-267899d0f3a4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 32520 microversion: 2.1 time: 0.191236 Apr 20 18:33:49.831091 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 145/298] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:49 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 32520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:50.652421 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a936dbbf-b0bf-4e7a-a730-bac6d9e79191 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:50.653639 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a936dbbf-b0bf-4e7a-a730-bac6d9e79191 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:50.663852 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a936dbbf-b0bf-4e7a-a730-bac6d9e79191 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:50.665329 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a936dbbf-b0bf-4e7a-a730-bac6d9e79191 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:50.666983 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a936dbbf-b0bf-4e7a-a730-bac6d9e79191 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:50.667494 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a936dbbf-b0bf-4e7a-a730-bac6d9e79191 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:50.732730 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e80497f0-de89-4e56-8b54-3197f5b79554 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:50.733896 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e80497f0-de89-4e56-8b54-3197f5b79554 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:50.751064 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e80497f0-de89-4e56-8b54-3197f5b79554 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:50.753454 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e80497f0-de89-4e56-8b54-3197f5b79554 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:50.755487 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e80497f0-de89-4e56-8b54-3197f5b79554 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:50.757380 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e80497f0-de89-4e56-8b54-3197f5b79554 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:50.871747 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a936dbbf-b0bf-4e7a-a730-bac6d9e79191 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 30532 microversion: 2.20 time: 0.225768 Apr 20 18:33:50.873289 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 154/299] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:50 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 30532 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:50.879421 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-30c4460a-5c07-475f-95a6-c9609e93df29 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:50.880922 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-30c4460a-5c07-475f-95a6-c9609e93df29 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:50.891707 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-30c4460a-5c07-475f-95a6-c9609e93df29 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:50.892662 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-30c4460a-5c07-475f-95a6-c9609e93df29 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:50.893823 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-30c4460a-5c07-475f-95a6-c9609e93df29 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:50.894525 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-30c4460a-5c07-475f-95a6-c9609e93df29 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:51.158080 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-30c4460a-5c07-475f-95a6-c9609e93df29 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 33108 microversion: 2.1 time: 0.282853 Apr 20 18:33:51.159421 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 155/300] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:50 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 33108 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:51.475555 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e80497f0-de89-4e56-8b54-3197f5b79554 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:51.486053 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e80497f0-de89-4e56-8b54-3197f5b79554 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1520 microversion: 2.1 time: 0.758448 Apr 20 18:33:51.487328 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 146/301] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:50 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1520 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:51.889244 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9e97a10f-de90-4cd4-9d29-dcd0d5c094b4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:51.891361 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9e97a10f-de90-4cd4-9d29-dcd0d5c094b4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:51.904038 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9e97a10f-de90-4cd4-9d29-dcd0d5c094b4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:51.906117 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9e97a10f-de90-4cd4-9d29-dcd0d5c094b4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:51.907354 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9e97a10f-de90-4cd4-9d29-dcd0d5c094b4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:51.908068 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9e97a10f-de90-4cd4-9d29-dcd0d5c094b4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:51.928892 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0409cf29-2512-483e-a27d-b3c029f8a46c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1adbef25-4598-46fd-999e-b0bd22f37858"}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:51.930435 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0409cf29-2512-483e-a27d-b3c029f8a46c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:51.947916 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0409cf29-2512-483e-a27d-b3c029f8a46c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:51.948437 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0409cf29-2512-483e-a27d-b3c029f8a46c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:51.953509 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0409cf29-2512-483e-a27d-b3c029f8a46c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:51.954669 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0409cf29-2512-483e-a27d-b3c029f8a46c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:52.116461 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9e97a10f-de90-4cd4-9d29-dcd0d5c094b4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 31449 microversion: 2.20 time: 0.234969 Apr 20 18:33:52.118114 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 156/302] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:51 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 31449 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:52.177260 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4ab8190a-7b2c-411e-b46d-e6fceb6b00b1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:52.179969 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4ab8190a-7b2c-411e-b46d-e6fceb6b00b1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:52.206948 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4ab8190a-7b2c-411e-b46d-e6fceb6b00b1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:52.207453 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4ab8190a-7b2c-411e-b46d-e6fceb6b00b1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:52.215589 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4ab8190a-7b2c-411e-b46d-e6fceb6b00b1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:52.216357 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4ab8190a-7b2c-411e-b46d-e6fceb6b00b1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:52.342911 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-0409cf29-2512-483e-a27d-b3c029f8a46c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] HTTP exception thrown: Invalid volume: volume 1adbef25-4598-46fd-999e-b0bd22f37858 is already attached to instances: dcbd1381-0624-4c44-8ad1-a058cf37eb89 Apr 20 18:33:52.343601 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0409cf29-2512-483e-a27d-b3c029f8a46c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Returning 400 to user: Invalid volume: volume 1adbef25-4598-46fd-999e-b0bd22f37858 is already attached to instances: dcbd1381-0624-4c44-8ad1-a058cf37eb89 {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:33:52.344542 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0409cf29-2512-483e-a27d-b3c029f8a46c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "POST /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.420642 Apr 20 18:33:52.353846 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 147/303] 10.222.0.25 () {60 vars in 1313 bytes} [Tue Apr 20 18:33:51 2021] POST /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89/os-volume_attachments => generated 174 bytes in 430 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:33:52.483623 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4ab8190a-7b2c-411e-b46d-e6fceb6b00b1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 33528 microversion: 2.1 time: 0.314685 Apr 20 18:33:52.485165 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 157/304] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:52 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 33528 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:52.510148 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-bcab2ab9-d91d-4465-8782-acf504a7b64d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:52.511581 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-bcab2ab9-d91d-4465-8782-acf504a7b64d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:52.557448 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bcab2ab9-d91d-4465-8782-acf504a7b64d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:52.558703 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bcab2ab9-d91d-4465-8782-acf504a7b64d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:52.560553 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bcab2ab9-d91d-4465-8782-acf504a7b64d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:52.561688 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bcab2ab9-d91d-4465-8782-acf504a7b64d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:52.739455 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c2cf0eb8-4c74-4fc5-bb7c-5bb58b938d9e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:52.739716 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c2cf0eb8-4c74-4fc5-bb7c-5bb58b938d9e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:52.761910 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c2cf0eb8-4c74-4fc5-bb7c-5bb58b938d9e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:52.762537 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c2cf0eb8-4c74-4fc5-bb7c-5bb58b938d9e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:52.763501 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c2cf0eb8-4c74-4fc5-bb7c-5bb58b938d9e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:52.764102 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c2cf0eb8-4c74-4fc5-bb7c-5bb58b938d9e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:52.975668 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-bcab2ab9-d91d-4465-8782-acf504a7b64d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:52.995190 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-bcab2ab9-d91d-4465-8782-acf504a7b64d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1520 microversion: 2.1 time: 0.492525 Apr 20 18:33:52.996383 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 148/305] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:52 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1520 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:53.132454 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-85d0d26f-b457-429a-b532-d4413db82879 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:53.134309 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-85d0d26f-b457-429a-b532-d4413db82879 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:53.142682 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-85d0d26f-b457-429a-b532-d4413db82879 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:53.143256 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-85d0d26f-b457-429a-b532-d4413db82879 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:53.144226 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-85d0d26f-b457-429a-b532-d4413db82879 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:53.144720 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-85d0d26f-b457-429a-b532-d4413db82879 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:53.334353 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-85d0d26f-b457-429a-b532-d4413db82879 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 32493 microversion: 2.20 time: 0.206313 Apr 20 18:33:53.335364 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 149/306] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:53 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 32493 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:33:53.498760 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8ae589e0-ccb4-4775-bde4-f1d4a56a6ae1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:53.500619 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8ae589e0-ccb4-4775-bde4-f1d4a56a6ae1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:53.511479 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8ae589e0-ccb4-4775-bde4-f1d4a56a6ae1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:53.512277 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8ae589e0-ccb4-4775-bde4-f1d4a56a6ae1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:53.513280 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8ae589e0-ccb4-4775-bde4-f1d4a56a6ae1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:53.514143 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8ae589e0-ccb4-4775-bde4-f1d4a56a6ae1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:53.526748 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-c2cf0eb8-4c74-4fc5-bb7c-5bb58b938d9e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lazy-loading 'services' on Instance uuid dcbd1381-0624-4c44-8ad1-a058cf37eb89 {{(pid=100593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:33:53.718316 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8ae589e0-ccb4-4775-bde4-f1d4a56a6ae1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 34072 microversion: 2.1 time: 0.223970 Apr 20 18:33:53.720164 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 150/307] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:53 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 34072 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:33:53.755174 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c2cf0eb8-4c74-4fc5-bb7c-5bb58b938d9e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89/os-volume_attachments/1adbef25-4598-46fd-999e-b0bd22f37858" status: 202 len: 0 microversion: 2.1 time: 1.022147 Apr 20 18:33:53.755938 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 158/308] 10.222.0.25 () {58 vars in 1406 bytes} [Tue Apr 20 18:33:52 2021] DELETE /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89/os-volume_attachments/1adbef25-4598-46fd-999e-b0bd22f37858 => generated 0 bytes in 1024 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:54.023158 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2b2ea00d-62e3-4d8d-8c1b-0c93a1a3ff2e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:54.024017 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2b2ea00d-62e3-4d8d-8c1b-0c93a1a3ff2e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:54.032611 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2b2ea00d-62e3-4d8d-8c1b-0c93a1a3ff2e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:54.033143 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2b2ea00d-62e3-4d8d-8c1b-0c93a1a3ff2e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:54.033983 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2b2ea00d-62e3-4d8d-8c1b-0c93a1a3ff2e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:54.034480 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2b2ea00d-62e3-4d8d-8c1b-0c93a1a3ff2e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:54.260353 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2b2ea00d-62e3-4d8d-8c1b-0c93a1a3ff2e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:54.269479 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2b2ea00d-62e3-4d8d-8c1b-0c93a1a3ff2e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1520 microversion: 2.1 time: 0.250787 Apr 20 18:33:54.270135 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 151/309] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:54 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:54.349168 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c44ae4cd-8d6f-455b-8fd1-9d92fb6cec45 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:54.350436 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c44ae4cd-8d6f-455b-8fd1-9d92fb6cec45 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:54.359472 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c44ae4cd-8d6f-455b-8fd1-9d92fb6cec45 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:54.359987 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c44ae4cd-8d6f-455b-8fd1-9d92fb6cec45 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:54.360904 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c44ae4cd-8d6f-455b-8fd1-9d92fb6cec45 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:54.361329 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c44ae4cd-8d6f-455b-8fd1-9d92fb6cec45 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:54.534547 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c44ae4cd-8d6f-455b-8fd1-9d92fb6cec45 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 33074 microversion: 2.20 time: 0.189537 Apr 20 18:33:54.535309 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 159/310] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:54 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 33074 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:54.731959 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-74f67fd3-fb0d-4c04-8736-da0ab700b7e5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:54.733222 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-74f67fd3-fb0d-4c04-8736-da0ab700b7e5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:54.741227 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-74f67fd3-fb0d-4c04-8736-da0ab700b7e5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:54.743668 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-74f67fd3-fb0d-4c04-8736-da0ab700b7e5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:54.743668 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-74f67fd3-fb0d-4c04-8736-da0ab700b7e5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:54.743879 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-74f67fd3-fb0d-4c04-8736-da0ab700b7e5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:54.911315 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-74f67fd3-fb0d-4c04-8736-da0ab700b7e5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 34628 microversion: 2.1 time: 0.183473 Apr 20 18:33:54.912380 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 152/311] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:54 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 34628 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:55.289862 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-953adb40-2fd1-47ba-b0d9-7a740555e8b3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:55.290660 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-953adb40-2fd1-47ba-b0d9-7a740555e8b3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:55.299500 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-953adb40-2fd1-47ba-b0d9-7a740555e8b3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:55.300016 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-953adb40-2fd1-47ba-b0d9-7a740555e8b3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:55.300873 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-953adb40-2fd1-47ba-b0d9-7a740555e8b3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:55.301373 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-953adb40-2fd1-47ba-b0d9-7a740555e8b3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:55.545738 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-953adb40-2fd1-47ba-b0d9-7a740555e8b3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:55.548184 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-24007d21-35c3-4b83-83d4-6840aff64b3a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:55.549328 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-24007d21-35c3-4b83-83d4-6840aff64b3a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:55.557019 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-953adb40-2fd1-47ba-b0d9-7a740555e8b3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1520 microversion: 2.1 time: 0.272048 Apr 20 18:33:55.557798 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 160/312] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:55 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:55.559044 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-24007d21-35c3-4b83-83d4-6840aff64b3a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:55.559552 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-24007d21-35c3-4b83-83d4-6840aff64b3a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:55.560452 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-24007d21-35c3-4b83-83d4-6840aff64b3a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:55.561000 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-24007d21-35c3-4b83-83d4-6840aff64b3a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:55.718534 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-24007d21-35c3-4b83-83d4-6840aff64b3a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 33473 microversion: 2.20 time: 0.174656 Apr 20 18:33:55.719423 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 153/313] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:55 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 33473 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:33:55.787577 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-80639350-2b37-4c08-a9e7-73fcf97b8670 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-666748739", "imageRef": "ba8326d8-5d1b-42a2-a65e-f1108a025e30", "flavorRef": "452", "networks": [{"uuid": "c8c07f4f-8832-4bd2-8650-ac17f6efb3d3"}]}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:55.860781 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.network.neutron [None req-80639350-2b37-4c08-a9e7-73fcf97b8670 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] validate_networks() for [('c8c07f4f-8832-4bd2-8650-ac17f6efb3d3', None, None, None)] {{(pid=100593) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:33:55.925748 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-54370f38-e87b-4fa6-8a28-583b86c20169 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:55.927156 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-54370f38-e87b-4fa6-8a28-583b86c20169 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:55.936425 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-54370f38-e87b-4fa6-8a28-583b86c20169 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:55.937048 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-54370f38-e87b-4fa6-8a28-583b86c20169 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:55.938455 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-54370f38-e87b-4fa6-8a28-583b86c20169 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:55.939028 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-54370f38-e87b-4fa6-8a28-583b86c20169 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:56.115099 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-54370f38-e87b-4fa6-8a28-583b86c20169 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 35269 microversion: 2.1 time: 0.194435 Apr 20 18:33:56.120365 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 154/314] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:55 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 35269 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:33:56.251122 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f5f9aa4f-ccc9-4a75-adbc-610756605389 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-93390634", "imageRef": "ba8326d8-5d1b-42a2-a65e-f1108a025e30", "flavorRef": "452", "networks": [{"uuid": "cc0a5556-9f4f-4012-a49b-d7d22905fe39"}]}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:56.349809 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.network.neutron [None req-f5f9aa4f-ccc9-4a75-adbc-610756605389 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] validate_networks() for [('cc0a5556-9f4f-4012-a49b-d7d22905fe39', None, None, None)] {{(pid=100592) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:33:56.524864 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-80639350-2b37-4c08-a9e7-73fcf97b8670 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Flavor limits 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:33:56.528075 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-80639350-2b37-4c08-a9e7-73fcf97b8670 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Image limits 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:33:56.529495 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-80639350-2b37-4c08-a9e7-73fcf97b8670 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Flavor pref 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:33:56.530644 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-80639350-2b37-4c08-a9e7-73fcf97b8670 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Image pref 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:33:56.533785 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-80639350-2b37-4c08-a9e7-73fcf97b8670 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:33:56.556980 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-80639350-2b37-4c08-a9e7-73fcf97b8670 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:56.559081 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-80639350-2b37-4c08-a9e7-73fcf97b8670 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:56.561175 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-80639350-2b37-4c08-a9e7-73fcf97b8670 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:56.562082 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-80639350-2b37-4c08-a9e7-73fcf97b8670 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:56.604680 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-80639350-2b37-4c08-a9e7-73fcf97b8670 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Getting quotas for project 977d101190a341ceb8e52a3b3e91678f. Resources: {'instances', 'ram', 'cores'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:33:56.614523 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-80639350-2b37-4c08-a9e7-73fcf97b8670 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Getting quotas for user aa06da535517426ca314d698b0067e4d and project 977d101190a341ceb8e52a3b3e91678f. Resources: {'instances', 'ram', 'cores'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:33:56.633849 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-80639350-2b37-4c08-a9e7-73fcf97b8670 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Going to run 1 instances... {{(pid=100593) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:33:56.637735 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-80639350-2b37-4c08-a9e7-73fcf97b8670 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba8326d8-5d1b-42a2-a65e-f1108a025e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:33:56.706764 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-80639350-2b37-4c08-a9e7-73fcf97b8670 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.923223 Apr 20 18:33:56.707618 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 161/315] 10.222.0.25 () {60 vars in 1137 bytes} [Tue Apr 20 18:33:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:33:56.719099 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b383de6a-f01f-4659-a907-fa9e6e106c10 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:56.720047 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b383de6a-f01f-4659-a907-fa9e6e106c10 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:56.730754 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b383de6a-f01f-4659-a907-fa9e6e106c10 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:56.731644 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b383de6a-f01f-4659-a907-fa9e6e106c10 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:56.732756 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b383de6a-f01f-4659-a907-fa9e6e106c10 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:56.733254 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b383de6a-f01f-4659-a907-fa9e6e106c10 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:57.158939 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-f5f9aa4f-ccc9-4a75-adbc-610756605389 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Flavor limits 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:33:57.159359 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-f5f9aa4f-ccc9-4a75-adbc-610756605389 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Image limits 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:33:57.160071 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-f5f9aa4f-ccc9-4a75-adbc-610756605389 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Flavor pref 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:33:57.160515 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-f5f9aa4f-ccc9-4a75-adbc-610756605389 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Image pref 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:33:57.161170 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-f5f9aa4f-ccc9-4a75-adbc-610756605389 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:33:57.173248 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f5f9aa4f-ccc9-4a75-adbc-610756605389 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:57.174095 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f5f9aa4f-ccc9-4a75-adbc-610756605389 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:57.175245 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f5f9aa4f-ccc9-4a75-adbc-610756605389 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:57.175954 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f5f9aa4f-ccc9-4a75-adbc-610756605389 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:57.200956 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-f5f9aa4f-ccc9-4a75-adbc-610756605389 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Getting quotas for project 122aac624a214c548b32893da89374a1. Resources: {'instances', 'ram', 'cores'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:33:57.206269 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-f5f9aa4f-ccc9-4a75-adbc-610756605389 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Getting quotas for user 9b9bccd8af9040fd946ccb99ac8941dd and project 122aac624a214c548b32893da89374a1. Resources: {'instances', 'ram', 'cores'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:33:57.220651 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f5f9aa4f-ccc9-4a75-adbc-610756605389 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Going to run 1 instances... {{(pid=100592) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:33:57.223833 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f5f9aa4f-ccc9-4a75-adbc-610756605389 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba8326d8-5d1b-42a2-a65e-f1108a025e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100592) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:33:57.305862 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f5f9aa4f-ccc9-4a75-adbc-610756605389 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.059821 Apr 20 18:33:57.306605 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 155/316] 10.222.0.25 () {60 vars in 1137 bytes} [Tue Apr 20 18:33:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:33:57.314814 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-388e1690-e044-48b6-be50-fd6b8cae0b72 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:57.315994 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-388e1690-e044-48b6-be50-fd6b8cae0b72 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:57.340210 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b383de6a-f01f-4659-a907-fa9e6e106c10 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:57.357471 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b383de6a-f01f-4659-a907-fa9e6e106c10 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1520 microversion: 2.1 time: 0.644599 Apr 20 18:33:57.358280 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 162/317] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:56 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1520 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:57.383483 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4149f439-0444-4797-93e5-8132d0ed4132 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:57.384924 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4149f439-0444-4797-93e5-8132d0ed4132 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:57.416915 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-388e1690-e044-48b6-be50-fd6b8cae0b72 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:57.417557 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4149f439-0444-4797-93e5-8132d0ed4132 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:57.418086 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4149f439-0444-4797-93e5-8132d0ed4132 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:57.418984 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4149f439-0444-4797-93e5-8132d0ed4132 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:57.419495 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4149f439-0444-4797-93e5-8132d0ed4132 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:57.431701 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-388e1690-e044-48b6-be50-fd6b8cae0b72 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1213 microversion: 2.1 time: 0.120639 Apr 20 18:33:57.431958 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 156/318] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:57 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1213 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:57.440024 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-add8c9c0-d54b-4fec-b9d8-dec974bc4bf4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:57.441514 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-add8c9c0-d54b-4fec-b9d8-dec974bc4bf4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:57.452251 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-add8c9c0-d54b-4fec-b9d8-dec974bc4bf4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:57.452774 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-add8c9c0-d54b-4fec-b9d8-dec974bc4bf4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:57.453739 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-add8c9c0-d54b-4fec-b9d8-dec974bc4bf4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:57.454244 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-add8c9c0-d54b-4fec-b9d8-dec974bc4bf4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:57.663444 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-add8c9c0-d54b-4fec-b9d8-dec974bc4bf4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 36155 microversion: 2.1 time: 0.229758 Apr 20 18:33:57.670122 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 157/319] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:57 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 36155 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:57.674040 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-345079ee-4117-4d58-9c45-84a14371133e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:57.678852 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-345079ee-4117-4d58-9c45-84a14371133e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:57.770625 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4149f439-0444-4797-93e5-8132d0ed4132 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 34258 microversion: 2.20 time: 0.410232 Apr 20 18:33:57.780448 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 163/320] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:57 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 34258 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:57.858455 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-345079ee-4117-4d58-9c45-84a14371133e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:57.884912 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-345079ee-4117-4d58-9c45-84a14371133e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1216 microversion: 2.1 time: 0.218125 Apr 20 18:33:57.886038 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 158/321] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:57 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1216 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:58.409509 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-488e6c36-1c9e-43b3-8f77-da4fe2166312 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:58.412970 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-488e6c36-1c9e-43b3-8f77-da4fe2166312 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:58.448626 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-488e6c36-1c9e-43b3-8f77-da4fe2166312 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:58.452014 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-488e6c36-1c9e-43b3-8f77-da4fe2166312 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:58.453091 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-488e6c36-1c9e-43b3-8f77-da4fe2166312 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:58.453662 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-488e6c36-1c9e-43b3-8f77-da4fe2166312 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:58.468219 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f9ca09d7-93d6-4143-b376-b690a75bdeda tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:58.468918 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f9ca09d7-93d6-4143-b376-b690a75bdeda tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:58.505265 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f9ca09d7-93d6-4143-b376-b690a75bdeda tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:58.518586 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f9ca09d7-93d6-4143-b376-b690a75bdeda tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:58.522830 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f9ca09d7-93d6-4143-b376-b690a75bdeda tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:58.525827 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f9ca09d7-93d6-4143-b376-b690a75bdeda tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:58.770351 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f9ca09d7-93d6-4143-b376-b690a75bdeda tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:58.785680 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f9ca09d7-93d6-4143-b376-b690a75bdeda tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1265 microversion: 2.1 time: 0.321016 Apr 20 18:33:58.788093 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 159/322] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:58 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1265 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:58.800127 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-31397f04-6c57-430c-9657-d251d9304440 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:58.802612 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-31397f04-6c57-430c-9657-d251d9304440 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:58.820854 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-31397f04-6c57-430c-9657-d251d9304440 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:58.822302 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-31397f04-6c57-430c-9657-d251d9304440 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:58.824135 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-31397f04-6c57-430c-9657-d251d9304440 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:58.825273 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-31397f04-6c57-430c-9657-d251d9304440 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:58.977359 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-488e6c36-1c9e-43b3-8f77-da4fe2166312 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:58.987501 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-488e6c36-1c9e-43b3-8f77-da4fe2166312 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1520 microversion: 2.1 time: 0.598440 Apr 20 18:33:59.001217 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 164/323] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:58 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1520 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:59.007016 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8de7e30c-530b-4549-b50d-19ab472cb232 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:33:59.008434 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8de7e30c-530b-4549-b50d-19ab472cb232 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:59.017920 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8de7e30c-530b-4549-b50d-19ab472cb232 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:59.018675 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8de7e30c-530b-4549-b50d-19ab472cb232 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:59.020112 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8de7e30c-530b-4549-b50d-19ab472cb232 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:59.020935 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8de7e30c-530b-4549-b50d-19ab472cb232 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:59.057803 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-31397f04-6c57-430c-9657-d251d9304440 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 36990 microversion: 2.1 time: 0.265684 Apr 20 18:33:59.059502 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 160/324] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:33:58 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 36990 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:33:59.089353 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-df8dadc0-cc7b-4148-b4de-1cd4935b9ede tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:59.090905 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-df8dadc0-cc7b-4148-b4de-1cd4935b9ede tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:59.115918 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df8dadc0-cc7b-4148-b4de-1cd4935b9ede tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:59.116663 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df8dadc0-cc7b-4148-b4de-1cd4935b9ede tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:59.131855 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df8dadc0-cc7b-4148-b4de-1cd4935b9ede tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:59.133329 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df8dadc0-cc7b-4148-b4de-1cd4935b9ede tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:59.265365 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8de7e30c-530b-4549-b50d-19ab472cb232 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 34952 microversion: 2.20 time: 0.262028 Apr 20 18:33:59.266410 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 165/325] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:33:59 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 34952 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:33:59.359724 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-df8dadc0-cc7b-4148-b4de-1cd4935b9ede tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:33:59.405312 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-df8dadc0-cc7b-4148-b4de-1cd4935b9ede tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1268 microversion: 2.1 time: 0.341896 Apr 20 18:33:59.406784 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 161/326] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:59 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1268 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:33:59.813487 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-799778c2-f862-40a1-985a-f777e33b2709 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:33:59.815961 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-799778c2-f862-40a1-985a-f777e33b2709 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:33:59.829362 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-799778c2-f862-40a1-985a-f777e33b2709 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:59.830162 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-799778c2-f862-40a1-985a-f777e33b2709 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:33:59.832141 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-799778c2-f862-40a1-985a-f777e33b2709 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:33:59.832850 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-799778c2-f862-40a1-985a-f777e33b2709 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:00.010218 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-66930e3f-7674-4e18-86f6-582451a83413 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:00.011243 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-66930e3f-7674-4e18-86f6-582451a83413 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:00.024044 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-66930e3f-7674-4e18-86f6-582451a83413 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:00.025059 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-66930e3f-7674-4e18-86f6-582451a83413 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:00.026372 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-66930e3f-7674-4e18-86f6-582451a83413 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:00.027481 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-66930e3f-7674-4e18-86f6-582451a83413 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:00.263860 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-799778c2-f862-40a1-985a-f777e33b2709 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:00.275069 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-799778c2-f862-40a1-985a-f777e33b2709 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1271 microversion: 2.1 time: 0.467047 Apr 20 18:34:00.275692 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 166/327] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:33:59 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1271 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:00.281968 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-fbedec87-2357-4190-a2ab-d600facf210e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:00.283184 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-fbedec87-2357-4190-a2ab-d600facf210e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:00.293761 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fbedec87-2357-4190-a2ab-d600facf210e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:00.294565 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fbedec87-2357-4190-a2ab-d600facf210e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:00.295581 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fbedec87-2357-4190-a2ab-d600facf210e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:00.297754 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fbedec87-2357-4190-a2ab-d600facf210e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:00.587961 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-fbedec87-2357-4190-a2ab-d600facf210e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 37818 microversion: 2.1 time: 0.305722 Apr 20 18:34:00.588939 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 167/328] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:34:00 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 37818 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:34:00.604602 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-70e49be4-aa5f-4359-a92b-f5590aade247 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:00.607203 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-70e49be4-aa5f-4359-a92b-f5590aade247 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:00.633619 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-70e49be4-aa5f-4359-a92b-f5590aade247 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:00.634763 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-70e49be4-aa5f-4359-a92b-f5590aade247 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:00.641732 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-70e49be4-aa5f-4359-a92b-f5590aade247 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:00.643387 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-70e49be4-aa5f-4359-a92b-f5590aade247 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:00.719248 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-66930e3f-7674-4e18-86f6-582451a83413 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:00.731087 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-66930e3f-7674-4e18-86f6-582451a83413 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1520 microversion: 2.1 time: 0.727954 Apr 20 18:34:00.731770 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 162/329] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:00 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1520 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:00.759327 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-cc9af900-ac50-48cd-bc4f-2215dd7ba1cb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:00.759859 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-cc9af900-ac50-48cd-bc4f-2215dd7ba1cb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:00.777795 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cc9af900-ac50-48cd-bc4f-2215dd7ba1cb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:00.778308 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cc9af900-ac50-48cd-bc4f-2215dd7ba1cb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:00.779191 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cc9af900-ac50-48cd-bc4f-2215dd7ba1cb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:00.779689 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cc9af900-ac50-48cd-bc4f-2215dd7ba1cb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:00.963346 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-70e49be4-aa5f-4359-a92b-f5590aade247 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 35721 microversion: 2.20 time: 0.370487 Apr 20 18:34:00.965626 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 168/330] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:34:00 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 35721 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:34:01.099139 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-cc9af900-ac50-48cd-bc4f-2215dd7ba1cb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:01.113869 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-cc9af900-ac50-48cd-bc4f-2215dd7ba1cb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1274 microversion: 2.1 time: 0.359116 Apr 20 18:34:01.114895 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 163/331] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:00 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1274 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:01.295384 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e046e780-3a5a-40da-a374-5d61fae8f994 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:01.296141 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e046e780-3a5a-40da-a374-5d61fae8f994 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:01.313720 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e046e780-3a5a-40da-a374-5d61fae8f994 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:01.314297 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e046e780-3a5a-40da-a374-5d61fae8f994 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:01.315155 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e046e780-3a5a-40da-a374-5d61fae8f994 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:01.318378 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e046e780-3a5a-40da-a374-5d61fae8f994 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:01.609006 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f99fc17c-c60b-4b51-8b9b-a7de26556efa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:01.623132 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f99fc17c-c60b-4b51-8b9b-a7de26556efa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:01.641437 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f99fc17c-c60b-4b51-8b9b-a7de26556efa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:01.642680 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f99fc17c-c60b-4b51-8b9b-a7de26556efa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:01.646063 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f99fc17c-c60b-4b51-8b9b-a7de26556efa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:01.647155 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f99fc17c-c60b-4b51-8b9b-a7de26556efa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:01.949286 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f99fc17c-c60b-4b51-8b9b-a7de26556efa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 38156 microversion: 2.1 time: 0.351899 Apr 20 18:34:01.950056 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 164/332] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:34:01 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 38156 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:34:01.963270 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d640a04f-fc9e-429d-ab59-8cbcd488b979 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:01.964080 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d640a04f-fc9e-429d-ab59-8cbcd488b979 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:01.986273 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d640a04f-fc9e-429d-ab59-8cbcd488b979 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:01.986796 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d640a04f-fc9e-429d-ab59-8cbcd488b979 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:01.987669 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d640a04f-fc9e-429d-ab59-8cbcd488b979 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:01.988168 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d640a04f-fc9e-429d-ab59-8cbcd488b979 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:02.641246 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d640a04f-fc9e-429d-ab59-8cbcd488b979 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:02.661989 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d640a04f-fc9e-429d-ab59-8cbcd488b979 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1520 microversion: 2.1 time: 0.698429 Apr 20 18:34:02.662841 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 165/333] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:01 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1520 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:02.678026 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1356d66a-777f-4b79-9333-86d5e4854a33 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:02.679793 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1356d66a-777f-4b79-9333-86d5e4854a33 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:02.702024 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1356d66a-777f-4b79-9333-86d5e4854a33 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:02.712555 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1356d66a-777f-4b79-9333-86d5e4854a33 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:02.713768 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1356d66a-777f-4b79-9333-86d5e4854a33 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:02.714602 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1356d66a-777f-4b79-9333-86d5e4854a33 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:03.006410 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1356d66a-777f-4b79-9333-86d5e4854a33 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 37080 microversion: 2.20 time: 0.341620 Apr 20 18:34:03.007193 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 166/334] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:34:02 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 37080 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:34:03.013207 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c12f932f-b5e7-46ef-ba89-e25276d2f60a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:03.014045 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c12f932f-b5e7-46ef-ba89-e25276d2f60a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:03.025579 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e046e780-3a5a-40da-a374-5d61fae8f994 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:03.031004 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c12f932f-b5e7-46ef-ba89-e25276d2f60a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:03.031517 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c12f932f-b5e7-46ef-ba89-e25276d2f60a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:03.032393 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c12f932f-b5e7-46ef-ba89-e25276d2f60a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:03.032888 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c12f932f-b5e7-46ef-ba89-e25276d2f60a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:03.041752 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e046e780-3a5a-40da-a374-5d61fae8f994 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1313 microversion: 2.1 time: 1.750744 Apr 20 18:34:03.052117 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 169/335] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:01 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1313 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:03.058380 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-441cf44b-93c0-4deb-84ae-749b81fd5d33 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:03.071757 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-441cf44b-93c0-4deb-84ae-749b81fd5d33 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:03.080883 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-441cf44b-93c0-4deb-84ae-749b81fd5d33 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:03.082086 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-441cf44b-93c0-4deb-84ae-749b81fd5d33 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:03.086000 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-441cf44b-93c0-4deb-84ae-749b81fd5d33 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:03.093934 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-441cf44b-93c0-4deb-84ae-749b81fd5d33 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:03.454572 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-441cf44b-93c0-4deb-84ae-749b81fd5d33 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 200 len: 38285 microversion: 2.1 time: 0.400271 Apr 20 18:34:03.455539 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 170/336] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:34:03 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 38285 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:34:03.469189 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-587100e7-e26a-4f7f-9f4b-bfd08493b7e9 req-e3224fe9-24dc-4404-873c-bae09822c7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c94a1f58-43bf-44d1-bcf5-3811d5910744", "tag": "6116c10b-a2ae-4688-ab93-903ec2d4df45"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:03.471356 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:34:03.471356 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:34:03.500796 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-587100e7-e26a-4f7f-9f4b-bfd08493b7e9 req-e3224fe9-24dc-4404-873c-bae09822c7a2 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:03.501697 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-587100e7-e26a-4f7f-9f4b-bfd08493b7e9 req-e3224fe9-24dc-4404-873c-bae09822c7a2 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:03.524481 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-587100e7-e26a-4f7f-9f4b-bfd08493b7e9 req-e3224fe9-24dc-4404-873c-bae09822c7a2 service nova] Creating event network-changed:6116c10b-a2ae-4688-ab93-903ec2d4df45 for instance c94a1f58-43bf-44d1-bcf5-3811d5910744 on hv-cinder-78693 Apr 20 18:34:03.530989 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-587100e7-e26a-4f7f-9f4b-bfd08493b7e9 req-e3224fe9-24dc-4404-873c-bae09822c7a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073362 Apr 20 18:34:03.532153 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 171/337] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:34:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:34:03.538276 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f8cb73e0-b902-4633-becb-ba33b1248523 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:03.539454 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f8cb73e0-b902-4633-becb-ba33b1248523 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:03.548200 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f8cb73e0-b902-4633-becb-ba33b1248523 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:03.549019 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f8cb73e0-b902-4633-becb-ba33b1248523 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:03.550172 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f8cb73e0-b902-4633-becb-ba33b1248523 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:03.550671 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f8cb73e0-b902-4633-becb-ba33b1248523 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:03.617507 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f8cb73e0-b902-4633-becb-ba33b1248523 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/ips" status: 200 len: 146 microversion: 2.1 time: 0.082662 Apr 20 18:34:03.618744 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 172/338] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Apr 20 18:34:03 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/ips => generated 146 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:34:03.692664 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9de325fd-d5bb-4d81-bc19-8a2de57ca72b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:03.694095 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9de325fd-d5bb-4d81-bc19-8a2de57ca72b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:03.734961 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9de325fd-d5bb-4d81-bc19-8a2de57ca72b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:03.736131 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9de325fd-d5bb-4d81-bc19-8a2de57ca72b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:03.743302 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9de325fd-d5bb-4d81-bc19-8a2de57ca72b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:03.744900 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9de325fd-d5bb-4d81-bc19-8a2de57ca72b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:03.858862 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c12f932f-b5e7-46ef-ba89-e25276d2f60a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:03.907210 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c12f932f-b5e7-46ef-ba89-e25276d2f60a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1316 microversion: 2.1 time: 0.898503 Apr 20 18:34:03.913056 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 167/339] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:03 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1316 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:04.026949 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-fda96727-b0dc-4bb9-94e7-013f6fc9386f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:04.037406 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-fda96727-b0dc-4bb9-94e7-013f6fc9386f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:04.048673 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fda96727-b0dc-4bb9-94e7-013f6fc9386f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:04.049579 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fda96727-b0dc-4bb9-94e7-013f6fc9386f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:04.052114 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fda96727-b0dc-4bb9-94e7-013f6fc9386f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:04.052833 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fda96727-b0dc-4bb9-94e7-013f6fc9386f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:04.243460 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-fda96727-b0dc-4bb9-94e7-013f6fc9386f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 37694 microversion: 2.20 time: 0.225657 Apr 20 18:34:04.249663 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 168/340] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:34:04 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 37694 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:34:04.258571 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-30de36a6-7745-4909-8ec3-139837de0630 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:04.260423 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-30de36a6-7745-4909-8ec3-139837de0630 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:04.272661 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-30de36a6-7745-4909-8ec3-139837de0630 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:04.273978 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-30de36a6-7745-4909-8ec3-139837de0630 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:04.275282 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-30de36a6-7745-4909-8ec3-139837de0630 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:04.275978 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-30de36a6-7745-4909-8ec3-139837de0630 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:04.629687 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9de325fd-d5bb-4d81-bc19-8a2de57ca72b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:04.645458 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9de325fd-d5bb-4d81-bc19-8a2de57ca72b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1520 microversion: 2.1 time: 0.960234 Apr 20 18:34:04.658145 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 173/341] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:03 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1520 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:04.685327 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-afa0cae7-40aa-42bb-9c19-af6835e57291 req-186d8f89-92f9-4087-87d1-104a5cfb2885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cc910f0-1c12-4462-acd1-89bb382a4005", "tag": "432b4968-6879-45da-a066-9f94c7121c73"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:04.689108 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:34:04.689108 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:34:04.708077 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-afa0cae7-40aa-42bb-9c19-af6835e57291 req-186d8f89-92f9-4087-87d1-104a5cfb2885 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:04.709036 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-afa0cae7-40aa-42bb-9c19-af6835e57291 req-186d8f89-92f9-4087-87d1-104a5cfb2885 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:04.752288 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-afa0cae7-40aa-42bb-9c19-af6835e57291 req-186d8f89-92f9-4087-87d1-104a5cfb2885 service nova] Creating event network-changed:432b4968-6879-45da-a066-9f94c7121c73 for instance 6cc910f0-1c12-4462-acd1-89bb382a4005 on hv-cinder-78693 Apr 20 18:34:04.762788 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-afa0cae7-40aa-42bb-9c19-af6835e57291 req-186d8f89-92f9-4087-87d1-104a5cfb2885 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085968 Apr 20 18:34:04.766366 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 174/342] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:34:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:34:04.820995 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-30de36a6-7745-4909-8ec3-139837de0630 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:04.830368 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-30de36a6-7745-4909-8ec3-139837de0630 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1313 microversion: 2.1 time: 0.578648 Apr 20 18:34:04.831011 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 169/343] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:04 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1313 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:04.934265 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-af72e9e4-27fa-4d37-a8af-8db458450695 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:04.935158 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-af72e9e4-27fa-4d37-a8af-8db458450695 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:04.944297 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-af72e9e4-27fa-4d37-a8af-8db458450695 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:04.945790 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-af72e9e4-27fa-4d37-a8af-8db458450695 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:04.946758 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-af72e9e4-27fa-4d37-a8af-8db458450695 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:04.947343 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-af72e9e4-27fa-4d37-a8af-8db458450695 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:05.265058 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-85ffda7d-3968-41c5-821c-695117f4b667 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:05.269766 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-85ffda7d-3968-41c5-821c-695117f4b667 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:05.287599 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-85ffda7d-3968-41c5-821c-695117f4b667 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:05.288600 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-85ffda7d-3968-41c5-821c-695117f4b667 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:05.290934 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-85ffda7d-3968-41c5-821c-695117f4b667 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:05.292002 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-85ffda7d-3968-41c5-821c-695117f4b667 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:05.350117 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-af72e9e4-27fa-4d37-a8af-8db458450695 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:05.390230 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-af72e9e4-27fa-4d37-a8af-8db458450695 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1316 microversion: 2.1 time: 0.460969 Apr 20 18:34:05.391503 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 175/344] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:04 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1316 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:34:05.627525 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-85ffda7d-3968-41c5-821c-695117f4b667 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 38102 microversion: 2.20 time: 0.371865 Apr 20 18:34:05.630068 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 170/345] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:34:05 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 38102 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:34:05.683207 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-52e2d9ab-2134-4c50-b99f-ec70a9a91c7b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:05.686225 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-52e2d9ab-2134-4c50-b99f-ec70a9a91c7b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:05.703141 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-52e2d9ab-2134-4c50-b99f-ec70a9a91c7b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:05.704671 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-52e2d9ab-2134-4c50-b99f-ec70a9a91c7b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:05.706459 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-52e2d9ab-2134-4c50-b99f-ec70a9a91c7b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:05.707612 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-52e2d9ab-2134-4c50-b99f-ec70a9a91c7b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:05.856636 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e09cf76a-1bf9-4a53-93ab-a7c6d3de7278 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:05.857949 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e09cf76a-1bf9-4a53-93ab-a7c6d3de7278 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:05.881866 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e09cf76a-1bf9-4a53-93ab-a7c6d3de7278 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:05.881866 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e09cf76a-1bf9-4a53-93ab-a7c6d3de7278 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:05.881866 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e09cf76a-1bf9-4a53-93ab-a7c6d3de7278 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:05.887561 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e09cf76a-1bf9-4a53-93ab-a7c6d3de7278 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:06.365224 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-52e2d9ab-2134-4c50-b99f-ec70a9a91c7b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:06.376526 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-52e2d9ab-2134-4c50-b99f-ec70a9a91c7b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1520 microversion: 2.1 time: 0.702807 Apr 20 18:34:06.377849 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 176/346] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:05 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1520 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:06.424936 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7c378688-924f-4e1f-8628-807c68e25fac tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:06.425987 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7c378688-924f-4e1f-8628-807c68e25fac tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:06.439325 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7c378688-924f-4e1f-8628-807c68e25fac tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:06.439836 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7c378688-924f-4e1f-8628-807c68e25fac tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:06.440701 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7c378688-924f-4e1f-8628-807c68e25fac tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:06.441198 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7c378688-924f-4e1f-8628-807c68e25fac tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:06.450359 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e09cf76a-1bf9-4a53-93ab-a7c6d3de7278 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:06.461880 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e09cf76a-1bf9-4a53-93ab-a7c6d3de7278 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1313 microversion: 2.1 time: 0.615277 Apr 20 18:34:06.463265 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 171/347] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:05 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1313 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:06.646968 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6d6bed0c-2f69-4e5f-a37b-8e8e652dd561 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:06.647138 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6d6bed0c-2f69-4e5f-a37b-8e8e652dd561 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:06.665048 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6d6bed0c-2f69-4e5f-a37b-8e8e652dd561 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:06.666050 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6d6bed0c-2f69-4e5f-a37b-8e8e652dd561 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:06.667689 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6d6bed0c-2f69-4e5f-a37b-8e8e652dd561 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:06.668636 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6d6bed0c-2f69-4e5f-a37b-8e8e652dd561 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:06.923709 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7c378688-924f-4e1f-8628-807c68e25fac tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:06.933548 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7c378688-924f-4e1f-8628-807c68e25fac tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1316 microversion: 2.1 time: 0.512980 Apr 20 18:34:06.934197 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 177/348] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:06 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1316 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:06.984131 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6d6bed0c-2f69-4e5f-a37b-8e8e652dd561 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 38234 microversion: 2.20 time: 0.344498 Apr 20 18:34:06.984872 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 172/349] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:34:06 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 38234 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:34:07.167556 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4a0e99f6-79be-4961-82bc-f6e4a62503cd tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e6d9959-4b1a-422b-a282-ffdb8d9b2e0b"}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:07.168834 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4a0e99f6-79be-4961-82bc-f6e4a62503cd tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:07.177217 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4a0e99f6-79be-4961-82bc-f6e4a62503cd tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:07.177697 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4a0e99f6-79be-4961-82bc-f6e4a62503cd tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:07.178544 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4a0e99f6-79be-4961-82bc-f6e4a62503cd tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:07.179045 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4a0e99f6-79be-4961-82bc-f6e4a62503cd tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:07.397189 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-cfcc2761-64f0-47da-be72-5c372ecb3596 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:07.398625 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-cfcc2761-64f0-47da-be72-5c372ecb3596 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:07.408179 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cfcc2761-64f0-47da-be72-5c372ecb3596 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:07.408567 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cfcc2761-64f0-47da-be72-5c372ecb3596 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:07.409450 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cfcc2761-64f0-47da-be72-5c372ecb3596 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:07.410025 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cfcc2761-64f0-47da-be72-5c372ecb3596 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:07.643285 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-cfcc2761-64f0-47da-be72-5c372ecb3596 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:07.653662 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-cfcc2761-64f0-47da-be72-5c372ecb3596 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1500 microversion: 2.1 time: 0.261191 Apr 20 18:34:07.654315 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 173/350] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:07 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1500 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:34:07.661865 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-fad10e32-16a1-4bac-b211-fce03a7ae213 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:07.661865 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-fad10e32-16a1-4bac-b211-fce03a7ae213 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:07.678683 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fad10e32-16a1-4bac-b211-fce03a7ae213 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:07.679433 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fad10e32-16a1-4bac-b211-fce03a7ae213 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:07.680483 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fad10e32-16a1-4bac-b211-fce03a7ae213 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:07.680931 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fad10e32-16a1-4bac-b211-fce03a7ae213 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:07.964489 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-fad10e32-16a1-4bac-b211-fce03a7ae213 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:07.974287 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-fad10e32-16a1-4bac-b211-fce03a7ae213 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1313 microversion: 2.1 time: 0.318613 Apr 20 18:34:07.974872 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 174/351] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:07 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:07.981250 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9f7bd9b6-e1c9-4ffe-81b6-7881e4b2b0d4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1bc2d86-639c-4637-b656-cfcc27b09697"}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:07.982522 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9f7bd9b6-e1c9-4ffe-81b6-7881e4b2b0d4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:07.997155 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9f7bd9b6-e1c9-4ffe-81b6-7881e4b2b0d4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:07.997973 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9f7bd9b6-e1c9-4ffe-81b6-7881e4b2b0d4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:07.999395 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9f7bd9b6-e1c9-4ffe-81b6-7881e4b2b0d4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:07.999916 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9f7bd9b6-e1c9-4ffe-81b6-7881e4b2b0d4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:08.065745 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-9f7bd9b6-e1c9-4ffe-81b6-7881e4b2b0d4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] HTTP exception thrown: Cannot 'attach_volume' instance aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d while it is in vm_state rescued Apr 20 18:34:08.066412 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9f7bd9b6-e1c9-4ffe-81b6-7881e4b2b0d4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Returning 409 to user: Cannot 'attach_volume' instance aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d while it is in vm_state rescued {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:34:08.067331 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9f7bd9b6-e1c9-4ffe-81b6-7881e4b2b0d4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "POST /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.091441 Apr 20 18:34:08.067970 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 175/352] 10.222.0.25 () {60 vars in 1313 bytes} [Tue Apr 20 18:34:07 2021] POST /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d/os-volume_attachments => generated 152 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 20 18:34:08.074117 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d2ccc7a8-f272-4c64-998a-870e4aefc4d9 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:08.074797 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d2ccc7a8-f272-4c64-998a-870e4aefc4d9 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:08.082947 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d2ccc7a8-f272-4c64-998a-870e4aefc4d9 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:08.083454 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d2ccc7a8-f272-4c64-998a-870e4aefc4d9 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:08.084318 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d2ccc7a8-f272-4c64-998a-870e4aefc4d9 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:08.084819 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d2ccc7a8-f272-4c64-998a-870e4aefc4d9 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:08.307229 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d2ccc7a8-f272-4c64-998a-870e4aefc4d9 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:08.316314 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d2ccc7a8-f272-4c64-998a-870e4aefc4d9 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1316 microversion: 2.1 time: 0.247270 Apr 20 18:34:08.316965 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 176/353] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:08 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:08.322473 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-31d7f6df-b0aa-4324-9ca3-291926ee5e2d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:08.323594 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-31d7f6df-b0aa-4324-9ca3-291926ee5e2d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:08.331635 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-31d7f6df-b0aa-4324-9ca3-291926ee5e2d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:08.332146 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-31d7f6df-b0aa-4324-9ca3-291926ee5e2d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:08.332998 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-31d7f6df-b0aa-4324-9ca3-291926ee5e2d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:08.333546 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-31d7f6df-b0aa-4324-9ca3-291926ee5e2d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:10.234303 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-31d7f6df-b0aa-4324-9ca3-291926ee5e2d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 200 len: 38241 microversion: 2.20 time: 1.915398 Apr 20 18:34:10.236542 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 177/354] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:34:08 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 38241 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:34:10.248905 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-79e9303e-3a1f-4ba5-9ee1-09bc0f4de5b5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:10.250359 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-79e9303e-3a1f-4ba5-9ee1-09bc0f4de5b5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:10.264251 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79e9303e-3a1f-4ba5-9ee1-09bc0f4de5b5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:10.264882 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79e9303e-3a1f-4ba5-9ee1-09bc0f4de5b5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:10.265995 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79e9303e-3a1f-4ba5-9ee1-09bc0f4de5b5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:10.266505 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79e9303e-3a1f-4ba5-9ee1-09bc0f4de5b5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:10.409644 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4a0e99f6-79be-4961-82bc-f6e4a62503cd tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.247413 Apr 20 18:34:10.410677 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 178/355] 10.222.0.25 () {60 vars in 1313 bytes} [Tue Apr 20 18:34:07 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/os-volume_attachments => generated 194 bytes in 3250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:34:10.443916 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9d9ce0f7-06af-45ea-9e98-f65725c287a6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:10.445263 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9d9ce0f7-06af-45ea-9e98-f65725c287a6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:10.455549 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9d9ce0f7-06af-45ea-9e98-f65725c287a6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:10.456063 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9d9ce0f7-06af-45ea-9e98-f65725c287a6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:10.456937 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9d9ce0f7-06af-45ea-9e98-f65725c287a6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:10.457485 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9d9ce0f7-06af-45ea-9e98-f65725c287a6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:10.505935 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-79e9303e-3a1f-4ba5-9ee1-09bc0f4de5b5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "POST /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d/action" status: 202 len: 0 microversion: 2.1 time: 0.266318 Apr 20 18:34:10.511338 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 178/356] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:34:10 2021] POST /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:34:10.520945 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2d22b262-92d3-4dbf-9d7b-97998a58b87c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:10.535191 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2d22b262-92d3-4dbf-9d7b-97998a58b87c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:10.578850 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2d22b262-92d3-4dbf-9d7b-97998a58b87c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:10.578850 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2d22b262-92d3-4dbf-9d7b-97998a58b87c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:10.578850 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2d22b262-92d3-4dbf-9d7b-97998a58b87c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:10.578850 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2d22b262-92d3-4dbf-9d7b-97998a58b87c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:10.905573 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2d22b262-92d3-4dbf-9d7b-97998a58b87c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:10.924257 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2d22b262-92d3-4dbf-9d7b-97998a58b87c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1316 microversion: 2.1 time: 0.413100 Apr 20 18:34:10.925514 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 179/357] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:10 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1316 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:10.935299 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a7fcf035-16e6-44a7-8cff-ae3741d30728 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:10.936518 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a7fcf035-16e6-44a7-8cff-ae3741d30728 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:10.952596 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a7fcf035-16e6-44a7-8cff-ae3741d30728 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:10.953561 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a7fcf035-16e6-44a7-8cff-ae3741d30728 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:10.955479 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a7fcf035-16e6-44a7-8cff-ae3741d30728 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:10.956098 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a7fcf035-16e6-44a7-8cff-ae3741d30728 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:11.060046 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a7fcf035-16e6-44a7-8cff-ae3741d30728 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/ips" status: 200 len: 150 microversion: 2.20 time: 0.132828 Apr 20 18:34:11.066475 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 180/358] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Apr 20 18:34:10 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/ips => generated 150 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:34:11.066475 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0ad9a4b9-7749-45f0-be0c-978989720edf tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:11.066741 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0ad9a4b9-7749-45f0-be0c-978989720edf tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:11.073883 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9d9ce0f7-06af-45ea-9e98-f65725c287a6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:11.075641 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0ad9a4b9-7749-45f0-be0c-978989720edf tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:11.076157 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0ad9a4b9-7749-45f0-be0c-978989720edf tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:11.077026 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0ad9a4b9-7749-45f0-be0c-978989720edf tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:11.077555 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0ad9a4b9-7749-45f0-be0c-978989720edf tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:11.085615 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9d9ce0f7-06af-45ea-9e98-f65725c287a6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1313 microversion: 2.1 time: 0.672981 Apr 20 18:34:11.096754 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 179/359] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:10 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1313 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:11.322237 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ed9febd0-f531-4808-bbba-1c393fbefc03 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46ba67ad-2698-4789-acd2-7dded5f4e3e0", "device": "/dev/sdb"}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:11.326682 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ed9febd0-f531-4808-bbba-1c393fbefc03 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:11.338310 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0ad9a4b9-7749-45f0-be0c-978989720edf tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:11.344349 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ed9febd0-f531-4808-bbba-1c393fbefc03 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:11.345016 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ed9febd0-f531-4808-bbba-1c393fbefc03 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:11.345939 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ed9febd0-f531-4808-bbba-1c393fbefc03 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:11.346527 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ed9febd0-f531-4808-bbba-1c393fbefc03 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:11.347821 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0ad9a4b9-7749-45f0-be0c-978989720edf tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1508 microversion: 2.1 time: 0.285700 Apr 20 18:34:11.348442 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 181/360] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:11 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1508 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:11.943490 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-05d1ec94-938d-429a-a1ae-a1ce9a6650da tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:11.944176 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-05d1ec94-938d-429a-a1ae-a1ce9a6650da tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:11.955046 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-05d1ec94-938d-429a-a1ae-a1ce9a6650da tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:11.956114 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-05d1ec94-938d-429a-a1ae-a1ce9a6650da tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:11.957610 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-05d1ec94-938d-429a-a1ae-a1ce9a6650da tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:11.958656 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-05d1ec94-938d-429a-a1ae-a1ce9a6650da tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:12.144807 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ed9febd0-f531-4808-bbba-1c393fbefc03 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "POST /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.827443 Apr 20 18:34:12.145698 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 180/361] 10.222.0.25 () {60 vars in 1313 bytes} [Tue Apr 20 18:34:11 2021] POST /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f/os-volume_attachments => generated 194 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:34:12.153620 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-27b2af01-e8df-440f-8f86-a0ee2fc7397f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:12.154876 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-27b2af01-e8df-440f-8f86-a0ee2fc7397f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:12.168832 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-27b2af01-e8df-440f-8f86-a0ee2fc7397f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:12.170185 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-27b2af01-e8df-440f-8f86-a0ee2fc7397f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:12.171287 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-27b2af01-e8df-440f-8f86-a0ee2fc7397f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:12.171998 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-27b2af01-e8df-440f-8f86-a0ee2fc7397f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:12.426667 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-05d1ec94-938d-429a-a1ae-a1ce9a6650da tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:12.440622 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-05d1ec94-938d-429a-a1ae-a1ce9a6650da tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1316 microversion: 2.1 time: 0.501293 Apr 20 18:34:12.454018 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 182/362] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:11 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1316 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:12.461327 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-78c29b80-7fc7-4bbf-8b7d-e3f3d6401ad6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:12.462090 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-78c29b80-7fc7-4bbf-8b7d-e3f3d6401ad6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:12.485844 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-78c29b80-7fc7-4bbf-8b7d-e3f3d6401ad6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:12.486372 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-78c29b80-7fc7-4bbf-8b7d-e3f3d6401ad6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:12.487250 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-78c29b80-7fc7-4bbf-8b7d-e3f3d6401ad6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:12.488160 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-78c29b80-7fc7-4bbf-8b7d-e3f3d6401ad6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:12.542077 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-27b2af01-e8df-440f-8f86-a0ee2fc7397f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:12.558985 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-27b2af01-e8df-440f-8f86-a0ee2fc7397f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1313 microversion: 2.1 time: 0.411443 Apr 20 18:34:12.569418 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 181/363] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:12 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:12.740062 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-78c29b80-7fc7-4bbf-8b7d-e3f3d6401ad6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:12.750017 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-78c29b80-7fc7-4bbf-8b7d-e3f3d6401ad6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1508 microversion: 2.1 time: 0.298438 Apr 20 18:34:12.750666 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 183/364] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:12 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1508 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:13.462996 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d308aa3e-2dd0-4ca8-8aa4-917de6d50a32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:13.463675 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d308aa3e-2dd0-4ca8-8aa4-917de6d50a32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:13.472445 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d308aa3e-2dd0-4ca8-8aa4-917de6d50a32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:13.472951 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d308aa3e-2dd0-4ca8-8aa4-917de6d50a32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:13.473858 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d308aa3e-2dd0-4ca8-8aa4-917de6d50a32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:13.474349 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d308aa3e-2dd0-4ca8-8aa4-917de6d50a32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:13.578832 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8aa27dac-640f-4f7d-acc3-a139230df205 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:13.579457 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8aa27dac-640f-4f7d-acc3-a139230df205 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:13.589563 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8aa27dac-640f-4f7d-acc3-a139230df205 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:13.590175 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8aa27dac-640f-4f7d-acc3-a139230df205 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:13.591122 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8aa27dac-640f-4f7d-acc3-a139230df205 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:13.591681 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8aa27dac-640f-4f7d-acc3-a139230df205 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:13.701373 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d308aa3e-2dd0-4ca8-8aa4-917de6d50a32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:13.710199 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d308aa3e-2dd0-4ca8-8aa4-917de6d50a32 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1316 microversion: 2.1 time: 0.251769 Apr 20 18:34:13.711619 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 182/365] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:13 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:13.770431 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-999b87b1-4eaa-488e-9193-e7ba272d356a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:13.771158 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-999b87b1-4eaa-488e-9193-e7ba272d356a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:13.787811 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-999b87b1-4eaa-488e-9193-e7ba272d356a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:13.789067 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-999b87b1-4eaa-488e-9193-e7ba272d356a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:13.789910 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-999b87b1-4eaa-488e-9193-e7ba272d356a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:13.790401 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-999b87b1-4eaa-488e-9193-e7ba272d356a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:13.815557 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8aa27dac-640f-4f7d-acc3-a139230df205 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:13.825307 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8aa27dac-640f-4f7d-acc3-a139230df205 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1313 microversion: 2.1 time: 0.251308 Apr 20 18:34:13.826028 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 184/366] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:13 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:34:14.019408 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-999b87b1-4eaa-488e-9193-e7ba272d356a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:14.029416 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-999b87b1-4eaa-488e-9193-e7ba272d356a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1508 microversion: 2.1 time: 0.262917 Apr 20 18:34:14.030125 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 183/367] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:13 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1508 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:34:14.730480 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b562c995-3527-40f4-8565-9006a80765a7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:14.731333 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b562c995-3527-40f4-8565-9006a80765a7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:14.739374 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b562c995-3527-40f4-8565-9006a80765a7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:14.739874 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b562c995-3527-40f4-8565-9006a80765a7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:14.740714 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b562c995-3527-40f4-8565-9006a80765a7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:14.741203 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b562c995-3527-40f4-8565-9006a80765a7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:14.844323 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4f2c0350-0c29-44be-8544-2db901beacda tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:14.844992 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4f2c0350-0c29-44be-8544-2db901beacda tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:14.853762 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4f2c0350-0c29-44be-8544-2db901beacda tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:14.854270 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4f2c0350-0c29-44be-8544-2db901beacda tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:14.855131 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4f2c0350-0c29-44be-8544-2db901beacda tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:14.855614 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4f2c0350-0c29-44be-8544-2db901beacda tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:14.982170 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b562c995-3527-40f4-8565-9006a80765a7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:14.996170 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b562c995-3527-40f4-8565-9006a80765a7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1316 microversion: 2.1 time: 0.270508 Apr 20 18:34:14.996836 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 185/368] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:14 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:15.048462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-67fedae4-0910-494f-a846-fd38e5f7b960 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:15.049186 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-67fedae4-0910-494f-a846-fd38e5f7b960 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:15.058715 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-67fedae4-0910-494f-a846-fd38e5f7b960 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:15.059321 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-67fedae4-0910-494f-a846-fd38e5f7b960 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:15.060429 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-67fedae4-0910-494f-a846-fd38e5f7b960 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:15.061061 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-67fedae4-0910-494f-a846-fd38e5f7b960 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:15.102232 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4f2c0350-0c29-44be-8544-2db901beacda tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:15.115117 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4f2c0350-0c29-44be-8544-2db901beacda tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1313 microversion: 2.1 time: 0.274874 Apr 20 18:34:15.116484 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 184/369] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:14 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:34:15.310774 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-67fedae4-0910-494f-a846-fd38e5f7b960 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:15.320770 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-67fedae4-0910-494f-a846-fd38e5f7b960 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1508 microversion: 2.1 time: 0.276311 Apr 20 18:34:15.321449 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 186/370] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:15 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1508 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:16.013875 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1fe0c9d0-1997-4d47-86f6-10244dc9fe96 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:16.014586 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1fe0c9d0-1997-4d47-86f6-10244dc9fe96 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:16.023673 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1fe0c9d0-1997-4d47-86f6-10244dc9fe96 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:16.024186 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1fe0c9d0-1997-4d47-86f6-10244dc9fe96 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:16.025045 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1fe0c9d0-1997-4d47-86f6-10244dc9fe96 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:16.025567 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1fe0c9d0-1997-4d47-86f6-10244dc9fe96 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:16.134597 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5335aa68-c1e1-4953-8bc9-21aa40af4d93 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:16.135248 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5335aa68-c1e1-4953-8bc9-21aa40af4d93 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:16.143590 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5335aa68-c1e1-4953-8bc9-21aa40af4d93 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:16.144101 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5335aa68-c1e1-4953-8bc9-21aa40af4d93 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:16.144962 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5335aa68-c1e1-4953-8bc9-21aa40af4d93 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:16.145669 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5335aa68-c1e1-4953-8bc9-21aa40af4d93 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:16.253047 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1fe0c9d0-1997-4d47-86f6-10244dc9fe96 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:16.263449 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1fe0c9d0-1997-4d47-86f6-10244dc9fe96 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1316 microversion: 2.1 time: 0.253518 Apr 20 18:34:16.264376 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 185/371] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:16 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1316 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:16.271892 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9145122e-e97d-4f84-9a59-8aa0c11c0d27 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:16.273666 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9145122e-e97d-4f84-9a59-8aa0c11c0d27 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:16.284084 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9145122e-e97d-4f84-9a59-8aa0c11c0d27 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:16.284825 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9145122e-e97d-4f84-9a59-8aa0c11c0d27 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:16.285704 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9145122e-e97d-4f84-9a59-8aa0c11c0d27 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:16.286200 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9145122e-e97d-4f84-9a59-8aa0c11c0d27 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:16.387671 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-9145122e-e97d-4f84-9a59-8aa0c11c0d27 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lazy-loading 'flavor' on Instance uuid 1e532f85-bed6-43d3-969d-3a2688b4638b {{(pid=100593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:34:16.388058 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5335aa68-c1e1-4953-8bc9-21aa40af4d93 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:16.398616 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5335aa68-c1e1-4953-8bc9-21aa40af4d93 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1313 microversion: 2.1 time: 0.267497 Apr 20 18:34:16.399244 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 187/372] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:16 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:34:16.411779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-770ee527-4663-4d02-851f-e5e88c22bd51 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:16.412519 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-770ee527-4663-4d02-851f-e5e88c22bd51 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:16.422748 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-770ee527-4663-4d02-851f-e5e88c22bd51 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:16.423259 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-770ee527-4663-4d02-851f-e5e88c22bd51 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:16.424121 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-770ee527-4663-4d02-851f-e5e88c22bd51 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:16.424617 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-770ee527-4663-4d02-851f-e5e88c22bd51 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:16.685225 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-770ee527-4663-4d02-851f-e5e88c22bd51 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:16.696420 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-770ee527-4663-4d02-851f-e5e88c22bd51 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1508 microversion: 2.1 time: 0.294848 Apr 20 18:34:16.698425 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 188/373] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:16 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1508 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:16.937729 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9145122e-e97d-4f84-9a59-8aa0c11c0d27 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 202 len: 0 microversion: 2.20 time: 0.670788 Apr 20 18:34:16.938663 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 186/374] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:34:16 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 0 bytes in 674 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:34:16.947808 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-232b6ebd-8aee-4707-8d09-469b044c4ef9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:16.948599 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-232b6ebd-8aee-4707-8d09-469b044c4ef9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:16.956918 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-232b6ebd-8aee-4707-8d09-469b044c4ef9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:16.957816 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-232b6ebd-8aee-4707-8d09-469b044c4ef9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:16.958421 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-232b6ebd-8aee-4707-8d09-469b044c4ef9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:16.958790 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-232b6ebd-8aee-4707-8d09-469b044c4ef9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:17.185436 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-232b6ebd-8aee-4707-8d09-469b044c4ef9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:17.195893 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-232b6ebd-8aee-4707-8d09-469b044c4ef9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:17.197603 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-232b6ebd-8aee-4707-8d09-469b044c4ef9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:17.198854 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-232b6ebd-8aee-4707-8d09-469b044c4ef9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.255430 Apr 20 18:34:17.199481 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 189/375] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:16 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:17.282970 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6129b557-b39a-4219-bce5-d7530b95ada6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:17.283754 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6129b557-b39a-4219-bce5-d7530b95ada6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:17.293942 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6129b557-b39a-4219-bce5-d7530b95ada6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:17.294463 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6129b557-b39a-4219-bce5-d7530b95ada6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:17.295340 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6129b557-b39a-4219-bce5-d7530b95ada6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:17.295842 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6129b557-b39a-4219-bce5-d7530b95ada6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:17.419263 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2b3ba376-5dce-4d1c-b407-e55a0a223a8e tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:17.419945 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2b3ba376-5dce-4d1c-b407-e55a0a223a8e tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:17.428649 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2b3ba376-5dce-4d1c-b407-e55a0a223a8e tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:17.430474 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2b3ba376-5dce-4d1c-b407-e55a0a223a8e tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:17.431399 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2b3ba376-5dce-4d1c-b407-e55a0a223a8e tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:17.431910 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2b3ba376-5dce-4d1c-b407-e55a0a223a8e tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:17.552430 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6129b557-b39a-4219-bce5-d7530b95ada6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:17.564131 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6129b557-b39a-4219-bce5-d7530b95ada6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1316 microversion: 2.1 time: 0.285030 Apr 20 18:34:17.565095 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 187/376] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:17 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:17.716429 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9e96bbc1-83d4-45cf-8a13-66824a9b4104 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:17.717097 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9e96bbc1-83d4-45cf-8a13-66824a9b4104 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:17.725119 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9e96bbc1-83d4-45cf-8a13-66824a9b4104 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:17.725721 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9e96bbc1-83d4-45cf-8a13-66824a9b4104 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:17.726563 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9e96bbc1-83d4-45cf-8a13-66824a9b4104 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:17.727051 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9e96bbc1-83d4-45cf-8a13-66824a9b4104 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:17.753358 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2b3ba376-5dce-4d1c-b407-e55a0a223a8e tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:17.763582 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2b3ba376-5dce-4d1c-b407-e55a0a223a8e tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1313 microversion: 2.1 time: 0.348375 Apr 20 18:34:17.764433 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 190/377] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:17 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:17.973260 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9e96bbc1-83d4-45cf-8a13-66824a9b4104 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:17.983889 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9e96bbc1-83d4-45cf-8a13-66824a9b4104 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1514 microversion: 2.1 time: 0.271418 Apr 20 18:34:17.984541 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 188/378] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:17 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1514 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:18.085306 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-df5ec5ab-b504-4e5c-90fd-8ffbd79f8390 req-67297e30-68fe-4058-b8f7-1107a5cf627f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c94a1f58-43bf-44d1-bcf5-3811d5910744", "name": "network-vif-plugged", "status": "completed", "tag": "6116c10b-a2ae-4688-ab93-903ec2d4df45"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:18.087821 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:34:18.087821 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:34:18.098416 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-df5ec5ab-b504-4e5c-90fd-8ffbd79f8390 req-67297e30-68fe-4058-b8f7-1107a5cf627f service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:18.098935 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-df5ec5ab-b504-4e5c-90fd-8ffbd79f8390 req-67297e30-68fe-4058-b8f7-1107a5cf627f service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:18.119279 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-df5ec5ab-b504-4e5c-90fd-8ffbd79f8390 req-67297e30-68fe-4058-b8f7-1107a5cf627f service nova] Creating event network-vif-plugged:6116c10b-a2ae-4688-ab93-903ec2d4df45 for instance c94a1f58-43bf-44d1-bcf5-3811d5910744 on hv-cinder-78693 Apr 20 18:34:18.124847 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-df5ec5ab-b504-4e5c-90fd-8ffbd79f8390 req-67297e30-68fe-4058-b8f7-1107a5cf627f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043566 Apr 20 18:34:18.125789 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 191/379] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:34:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:34:18.221138 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-42fa0baf-c1c0-4ff8-90e0-5571a772fb76 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:18.222536 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-42fa0baf-c1c0-4ff8-90e0-5571a772fb76 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:18.231513 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-42fa0baf-c1c0-4ff8-90e0-5571a772fb76 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:18.232028 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-42fa0baf-c1c0-4ff8-90e0-5571a772fb76 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:18.232866 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-42fa0baf-c1c0-4ff8-90e0-5571a772fb76 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:18.233415 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-42fa0baf-c1c0-4ff8-90e0-5571a772fb76 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:18.587772 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e190a3c5-c3da-4d37-9abb-4d36a79199b9 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:18.589201 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e190a3c5-c3da-4d37-9abb-4d36a79199b9 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:18.611855 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e190a3c5-c3da-4d37-9abb-4d36a79199b9 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:18.615341 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-42fa0baf-c1c0-4ff8-90e0-5571a772fb76 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:18.619422 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e190a3c5-c3da-4d37-9abb-4d36a79199b9 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:18.622573 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e190a3c5-c3da-4d37-9abb-4d36a79199b9 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:18.626715 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e190a3c5-c3da-4d37-9abb-4d36a79199b9 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:18.642420 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-42fa0baf-c1c0-4ff8-90e0-5571a772fb76 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:18.642420 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-42fa0baf-c1c0-4ff8-90e0-5571a772fb76 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:18.642420 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-42fa0baf-c1c0-4ff8-90e0-5571a772fb76 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.420098 Apr 20 18:34:18.644416 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 189/380] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:18 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:18.784999 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b80e2341-8dde-43d9-88bb-22c58fd1693b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:18.808008 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b80e2341-8dde-43d9-88bb-22c58fd1693b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:18.811989 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b80e2341-8dde-43d9-88bb-22c58fd1693b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:18.883209 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b80e2341-8dde-43d9-88bb-22c58fd1693b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Going to try to stop instance {{(pid=100593) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 20 18:34:18.957510 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e190a3c5-c3da-4d37-9abb-4d36a79199b9 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:18.968913 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e190a3c5-c3da-4d37-9abb-4d36a79199b9 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1316 microversion: 2.1 time: 0.389531 Apr 20 18:34:18.971975 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 192/381] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:18 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1316 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:18.972123 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b80e2341-8dde-43d9-88bb-22c58fd1693b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 202 len: 0 microversion: 2.1 time: 0.190687 Apr 20 18:34:18.972123 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 190/382] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:34:18 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:34:18.976537 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-52bee08e-6168-44b5-b4c7-65b7a9338335 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:18.977716 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-52bee08e-6168-44b5-b4c7-65b7a9338335 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:18.984239 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-315247c2-9846-4f8b-a2a9-471cf2d89a3e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:18.993770 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-315247c2-9846-4f8b-a2a9-471cf2d89a3e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:18.993926 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-52bee08e-6168-44b5-b4c7-65b7a9338335 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:18.993926 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-52bee08e-6168-44b5-b4c7-65b7a9338335 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:18.994806 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-52bee08e-6168-44b5-b4c7-65b7a9338335 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:18.994931 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-315247c2-9846-4f8b-a2a9-471cf2d89a3e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:18.995246 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-52bee08e-6168-44b5-b4c7-65b7a9338335 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:18.995505 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-315247c2-9846-4f8b-a2a9-471cf2d89a3e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:18.996467 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-315247c2-9846-4f8b-a2a9-471cf2d89a3e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:18.997056 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-315247c2-9846-4f8b-a2a9-471cf2d89a3e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:19.229419 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-52bee08e-6168-44b5-b4c7-65b7a9338335 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:19.232262 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-315247c2-9846-4f8b-a2a9-471cf2d89a3e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:19.238786 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-52bee08e-6168-44b5-b4c7-65b7a9338335 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1313 microversion: 2.1 time: 0.267938 Apr 20 18:34:19.239463 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 193/383] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:18 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:19.242359 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-315247c2-9846-4f8b-a2a9-471cf2d89a3e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.263493 Apr 20 18:34:19.243002 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 191/384] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:18 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:19.656836 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-cd1f8c0f-5579-4b05-ac1c-0c1b744c5ffb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:19.657540 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-cd1f8c0f-5579-4b05-ac1c-0c1b744c5ffb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:19.666304 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cd1f8c0f-5579-4b05-ac1c-0c1b744c5ffb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:19.666807 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cd1f8c0f-5579-4b05-ac1c-0c1b744c5ffb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:19.667661 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cd1f8c0f-5579-4b05-ac1c-0c1b744c5ffb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:19.668707 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cd1f8c0f-5579-4b05-ac1c-0c1b744c5ffb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:19.764971 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-782d31f5-fe15-49fc-beaa-8b0aabead59d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:19.765680 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-782d31f5-fe15-49fc-beaa-8b0aabead59d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:19.774659 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-782d31f5-fe15-49fc-beaa-8b0aabead59d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:19.775172 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-782d31f5-fe15-49fc-beaa-8b0aabead59d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:19.776030 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-782d31f5-fe15-49fc-beaa-8b0aabead59d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:19.777448 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-782d31f5-fe15-49fc-beaa-8b0aabead59d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:19.916742 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-cd1f8c0f-5579-4b05-ac1c-0c1b744c5ffb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:19.929678 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-cd1f8c0f-5579-4b05-ac1c-0c1b744c5ffb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:19.931700 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-cd1f8c0f-5579-4b05-ac1c-0c1b744c5ffb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:19.932965 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-cd1f8c0f-5579-4b05-ac1c-0c1b744c5ffb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.280337 Apr 20 18:34:19.933665 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 194/385] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:19 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:19.988536 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e06c8e95-c5b2-416f-b5c8-da251908d04a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:19.989348 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e06c8e95-c5b2-416f-b5c8-da251908d04a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:19.998317 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e06c8e95-c5b2-416f-b5c8-da251908d04a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:19.998828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e06c8e95-c5b2-416f-b5c8-da251908d04a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:19.999688 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e06c8e95-c5b2-416f-b5c8-da251908d04a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:20.000182 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e06c8e95-c5b2-416f-b5c8-da251908d04a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:20.020543 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-782d31f5-fe15-49fc-beaa-8b0aabead59d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:20.035076 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-782d31f5-fe15-49fc-beaa-8b0aabead59d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1514 microversion: 2.1 time: 0.274136 Apr 20 18:34:20.035749 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 192/386] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:19 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1514 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:20.053521 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d2e34476-f869-4f3f-af07-21b1be61cfbe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4073df06-b328-47bf-8ee8-0052772e4934"}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:20.055732 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d2e34476-f869-4f3f-af07-21b1be61cfbe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:20.066536 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d2e34476-f869-4f3f-af07-21b1be61cfbe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:20.067011 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d2e34476-f869-4f3f-af07-21b1be61cfbe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:20.067981 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d2e34476-f869-4f3f-af07-21b1be61cfbe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:20.068558 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d2e34476-f869-4f3f-af07-21b1be61cfbe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:20.266910 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e06c8e95-c5b2-416f-b5c8-da251908d04a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:20.276870 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e06c8e95-c5b2-416f-b5c8-da251908d04a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1316 microversion: 2.1 time: 0.292677 Apr 20 18:34:20.277548 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 195/387] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:19 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1316 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:34:20.282587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-74f989ea-ddca-4782-832f-315269974284 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:20.283268 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-74f989ea-ddca-4782-832f-315269974284 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:20.292055 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-74f989ea-ddca-4782-832f-315269974284 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:20.292575 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-74f989ea-ddca-4782-832f-315269974284 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:20.293442 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-74f989ea-ddca-4782-832f-315269974284 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:20.293947 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-74f989ea-ddca-4782-832f-315269974284 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:20.520833 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-74f989ea-ddca-4782-832f-315269974284 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:20.531752 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-74f989ea-ddca-4782-832f-315269974284 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1313 microversion: 2.1 time: 0.253052 Apr 20 18:34:20.532404 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 196/388] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:20 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:20.537140 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0c80fb4a-10c6-4526-adb0-44c6f7dd8f23 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:20.537902 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0c80fb4a-10c6-4526-adb0-44c6f7dd8f23 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:20.546669 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0c80fb4a-10c6-4526-adb0-44c6f7dd8f23 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:20.547173 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0c80fb4a-10c6-4526-adb0-44c6f7dd8f23 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:20.548018 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0c80fb4a-10c6-4526-adb0-44c6f7dd8f23 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:20.548505 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0c80fb4a-10c6-4526-adb0-44c6f7dd8f23 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:20.774487 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0c80fb4a-10c6-4526-adb0-44c6f7dd8f23 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:20.784122 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0c80fb4a-10c6-4526-adb0-44c6f7dd8f23 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.250634 Apr 20 18:34:20.784774 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 197/389] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:20 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:20.952056 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-148fd05e-fe3b-48e9-ae2b-9f1ca894a705 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:20.952726 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-148fd05e-fe3b-48e9-ae2b-9f1ca894a705 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:20.961712 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-148fd05e-fe3b-48e9-ae2b-9f1ca894a705 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:20.962219 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-148fd05e-fe3b-48e9-ae2b-9f1ca894a705 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:20.963064 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-148fd05e-fe3b-48e9-ae2b-9f1ca894a705 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:20.963552 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-148fd05e-fe3b-48e9-ae2b-9f1ca894a705 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:21.184645 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-148fd05e-fe3b-48e9-ae2b-9f1ca894a705 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:21.195104 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-148fd05e-fe3b-48e9-ae2b-9f1ca894a705 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:21.197005 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-148fd05e-fe3b-48e9-ae2b-9f1ca894a705 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:21.198299 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-148fd05e-fe3b-48e9-ae2b-9f1ca894a705 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.250382 Apr 20 18:34:21.198934 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 198/390] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:20 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:34:21.301375 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-48faedb0-5570-4100-969a-ae20f724d409 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:21.302095 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-48faedb0-5570-4100-969a-ae20f724d409 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:21.310488 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-48faedb0-5570-4100-969a-ae20f724d409 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:21.311004 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-48faedb0-5570-4100-969a-ae20f724d409 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:21.311864 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-48faedb0-5570-4100-969a-ae20f724d409 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:21.312357 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-48faedb0-5570-4100-969a-ae20f724d409 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:21.545018 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-48faedb0-5570-4100-969a-ae20f724d409 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:21.554894 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-48faedb0-5570-4100-969a-ae20f724d409 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1316 microversion: 2.1 time: 0.257583 Apr 20 18:34:21.555856 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 199/391] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:21 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:21.571445 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d4554aed-3c88-462f-93cb-e088c44b594e tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:21.572100 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d4554aed-3c88-462f-93cb-e088c44b594e tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:21.581665 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d4554aed-3c88-462f-93cb-e088c44b594e tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:21.582188 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d4554aed-3c88-462f-93cb-e088c44b594e tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:21.583103 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d4554aed-3c88-462f-93cb-e088c44b594e tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:21.583611 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d4554aed-3c88-462f-93cb-e088c44b594e tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:21.813916 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d4554aed-3c88-462f-93cb-e088c44b594e tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:21.822939 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d4554aed-3c88-462f-93cb-e088c44b594e tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1313 microversion: 2.1 time: 0.256825 Apr 20 18:34:21.823579 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 200/392] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:21 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:21.828389 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-29e86bd2-96e8-426e-9787-23104a8b658b req-14ef441d-091c-43d3-a3a5-d25b1a107d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc910f0-1c12-4462-acd1-89bb382a4005", "name": "network-vif-plugged", "status": "completed", "tag": "432b4968-6879-45da-a066-9f94c7121c73"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:21.830244 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:34:21.830244 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:34:21.839794 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-29e86bd2-96e8-426e-9787-23104a8b658b req-14ef441d-091c-43d3-a3a5-d25b1a107d37 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:21.840309 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-29e86bd2-96e8-426e-9787-23104a8b658b req-14ef441d-091c-43d3-a3a5-d25b1a107d37 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:21.858527 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-29e86bd2-96e8-426e-9787-23104a8b658b req-14ef441d-091c-43d3-a3a5-d25b1a107d37 service nova] Creating event network-vif-plugged:432b4968-6879-45da-a066-9f94c7121c73 for instance 6cc910f0-1c12-4462-acd1-89bb382a4005 on hv-cinder-78693 Apr 20 18:34:21.863644 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-29e86bd2-96e8-426e-9787-23104a8b658b req-14ef441d-091c-43d3-a3a5-d25b1a107d37 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038848 Apr 20 18:34:21.864302 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 201/393] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:34:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:34:21.869790 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-af83663b-c5a0-43e4-ad87-d28120e0a595 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:21.870573 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-af83663b-c5a0-43e4-ad87-d28120e0a595 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:21.878419 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-af83663b-c5a0-43e4-ad87-d28120e0a595 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:21.878939 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-af83663b-c5a0-43e4-ad87-d28120e0a595 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:21.879781 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-af83663b-c5a0-43e4-ad87-d28120e0a595 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:21.880282 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-af83663b-c5a0-43e4-ad87-d28120e0a595 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:22.102642 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-af83663b-c5a0-43e4-ad87-d28120e0a595 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:22.113713 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-af83663b-c5a0-43e4-ad87-d28120e0a595 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.248185 Apr 20 18:34:22.114349 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 202/394] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:21 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:22.217758 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f8c97223-cbfd-4fae-b7fe-9504c1d79798 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:22.218435 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f8c97223-cbfd-4fae-b7fe-9504c1d79798 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:22.226861 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f8c97223-cbfd-4fae-b7fe-9504c1d79798 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:22.227388 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f8c97223-cbfd-4fae-b7fe-9504c1d79798 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:22.228224 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f8c97223-cbfd-4fae-b7fe-9504c1d79798 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:22.228726 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f8c97223-cbfd-4fae-b7fe-9504c1d79798 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:22.455232 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f8c97223-cbfd-4fae-b7fe-9504c1d79798 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:22.486809 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f8c97223-cbfd-4fae-b7fe-9504c1d79798 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:22.488965 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f8c97223-cbfd-4fae-b7fe-9504c1d79798 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:22.490262 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f8c97223-cbfd-4fae-b7fe-9504c1d79798 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.276579 Apr 20 18:34:22.490886 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 203/395] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:22 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:22.572779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-12f37968-f0e8-4ae6-a9be-d7206e82bbd1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:22.573381 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-12f37968-f0e8-4ae6-a9be-d7206e82bbd1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:22.583070 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-12f37968-f0e8-4ae6-a9be-d7206e82bbd1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:22.583582 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-12f37968-f0e8-4ae6-a9be-d7206e82bbd1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:22.584430 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-12f37968-f0e8-4ae6-a9be-d7206e82bbd1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:22.585568 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-12f37968-f0e8-4ae6-a9be-d7206e82bbd1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:22.630355 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d2e34476-f869-4f3f-af07-21b1be61cfbe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "POST /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.580847 Apr 20 18:34:22.636222 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 193/396] 10.222.0.25 () {60 vars in 1313 bytes} [Tue Apr 20 18:34:20 2021] POST /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d/os-volume_attachments => generated 194 bytes in 2583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:34:22.844487 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5e024e86-debb-49a0-8e3d-2f43626b52f6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:22.845193 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5e024e86-debb-49a0-8e3d-2f43626b52f6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:22.860665 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-12f37968-f0e8-4ae6-a9be-d7206e82bbd1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:22.860833 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5e024e86-debb-49a0-8e3d-2f43626b52f6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:22.862224 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5e024e86-debb-49a0-8e3d-2f43626b52f6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:22.865256 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5e024e86-debb-49a0-8e3d-2f43626b52f6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:22.866011 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5e024e86-debb-49a0-8e3d-2f43626b52f6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:22.871348 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-12f37968-f0e8-4ae6-a9be-d7206e82bbd1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1316 microversion: 2.1 time: 0.302957 Apr 20 18:34:22.872164 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 204/397] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:22 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:34:23.120515 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5e024e86-debb-49a0-8e3d-2f43626b52f6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:23.129372 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5e024e86-debb-49a0-8e3d-2f43626b52f6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1313 microversion: 2.1 time: 0.291949 Apr 20 18:34:23.130061 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 194/398] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:22 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:23.132934 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-932c5055-b1b5-4ccd-aaad-76658bff7383 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:23.133651 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-932c5055-b1b5-4ccd-aaad-76658bff7383 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:23.142146 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-932c5055-b1b5-4ccd-aaad-76658bff7383 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:23.142653 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-932c5055-b1b5-4ccd-aaad-76658bff7383 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:23.143500 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-932c5055-b1b5-4ccd-aaad-76658bff7383 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:23.144406 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-932c5055-b1b5-4ccd-aaad-76658bff7383 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:23.362938 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-932c5055-b1b5-4ccd-aaad-76658bff7383 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:23.373296 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-932c5055-b1b5-4ccd-aaad-76658bff7383 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.244897 Apr 20 18:34:23.373906 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 205/399] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:23 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:34:23.509312 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7ea9f251-887f-4e7b-b497-870988420919 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:23.510168 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7ea9f251-887f-4e7b-b497-870988420919 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:23.518855 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7ea9f251-887f-4e7b-b497-870988420919 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:23.519371 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7ea9f251-887f-4e7b-b497-870988420919 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:23.520262 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7ea9f251-887f-4e7b-b497-870988420919 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:23.520757 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7ea9f251-887f-4e7b-b497-870988420919 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:23.740187 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7ea9f251-887f-4e7b-b497-870988420919 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:23.751246 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7ea9f251-887f-4e7b-b497-870988420919 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:23.752933 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7ea9f251-887f-4e7b-b497-870988420919 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:23.754197 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7ea9f251-887f-4e7b-b497-870988420919 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.249059 Apr 20 18:34:23.754791 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 195/400] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:23 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:23.891663 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9fd8fa0f-eadc-4452-a101-51e3f2c19257 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:23.892207 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9fd8fa0f-eadc-4452-a101-51e3f2c19257 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:23.900695 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9fd8fa0f-eadc-4452-a101-51e3f2c19257 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:23.901201 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9fd8fa0f-eadc-4452-a101-51e3f2c19257 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:23.902100 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9fd8fa0f-eadc-4452-a101-51e3f2c19257 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:23.902575 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9fd8fa0f-eadc-4452-a101-51e3f2c19257 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:24.149224 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c83b4065-b3c0-45c9-81b6-6d13c8805138 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:24.149985 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c83b4065-b3c0-45c9-81b6-6d13c8805138 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:24.158717 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c83b4065-b3c0-45c9-81b6-6d13c8805138 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:24.159218 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c83b4065-b3c0-45c9-81b6-6d13c8805138 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:24.160073 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c83b4065-b3c0-45c9-81b6-6d13c8805138 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:24.160560 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c83b4065-b3c0-45c9-81b6-6d13c8805138 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:24.373780 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9fd8fa0f-eadc-4452-a101-51e3f2c19257 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:24.395090 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9fd8fa0f-eadc-4452-a101-51e3f2c19257 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1316 microversion: 2.1 time: 0.507329 Apr 20 18:34:24.396009 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 206/401] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:23 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1316 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:24.401792 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b25d6fb1-d3e8-4097-a2a2-52e40961bba8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:24.406341 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b25d6fb1-d3e8-4097-a2a2-52e40961bba8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:24.418532 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b25d6fb1-d3e8-4097-a2a2-52e40961bba8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:24.419316 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b25d6fb1-d3e8-4097-a2a2-52e40961bba8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:24.420328 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b25d6fb1-d3e8-4097-a2a2-52e40961bba8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:24.420974 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b25d6fb1-d3e8-4097-a2a2-52e40961bba8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:24.426381 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c83b4065-b3c0-45c9-81b6-6d13c8805138 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:24.437380 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c83b4065-b3c0-45c9-81b6-6d13c8805138 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1313 microversion: 2.1 time: 0.293049 Apr 20 18:34:24.438387 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 196/402] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:24 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:34:24.660697 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b25d6fb1-d3e8-4097-a2a2-52e40961bba8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:24.671838 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b25d6fb1-d3e8-4097-a2a2-52e40961bba8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.274487 Apr 20 18:34:24.672506 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 207/403] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:24 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:24.775392 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-72cca9a6-e94c-4ded-92bc-accb5ecda747 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:24.776071 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-72cca9a6-e94c-4ded-92bc-accb5ecda747 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:24.783971 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-72cca9a6-e94c-4ded-92bc-accb5ecda747 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:24.784490 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-72cca9a6-e94c-4ded-92bc-accb5ecda747 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:24.785337 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-72cca9a6-e94c-4ded-92bc-accb5ecda747 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:24.785865 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-72cca9a6-e94c-4ded-92bc-accb5ecda747 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:25.022384 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-72cca9a6-e94c-4ded-92bc-accb5ecda747 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:25.031884 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-72cca9a6-e94c-4ded-92bc-accb5ecda747 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:25.033601 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-72cca9a6-e94c-4ded-92bc-accb5ecda747 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:25.035201 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-72cca9a6-e94c-4ded-92bc-accb5ecda747 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.264172 Apr 20 18:34:25.035474 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 197/404] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:24 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:25.415176 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4e93b638-2d76-4127-b6e8-f4f6606ce7ed tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:25.415896 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4e93b638-2d76-4127-b6e8-f4f6606ce7ed tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:25.424156 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4e93b638-2d76-4127-b6e8-f4f6606ce7ed tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:25.424587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4e93b638-2d76-4127-b6e8-f4f6606ce7ed tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:25.425446 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4e93b638-2d76-4127-b6e8-f4f6606ce7ed tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:25.425937 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4e93b638-2d76-4127-b6e8-f4f6606ce7ed tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:25.457210 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-698c7ec9-3304-48e2-b87b-09618e97bdf2 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:25.457952 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-698c7ec9-3304-48e2-b87b-09618e97bdf2 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:25.467555 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-698c7ec9-3304-48e2-b87b-09618e97bdf2 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:25.468064 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-698c7ec9-3304-48e2-b87b-09618e97bdf2 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:25.468910 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-698c7ec9-3304-48e2-b87b-09618e97bdf2 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:25.469419 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-698c7ec9-3304-48e2-b87b-09618e97bdf2 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:25.649961 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4e93b638-2d76-4127-b6e8-f4f6606ce7ed tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:25.659363 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4e93b638-2d76-4127-b6e8-f4f6606ce7ed tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1316 microversion: 2.1 time: 0.248459 Apr 20 18:34:25.660036 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 208/405] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:25 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:25.702822 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-41195cef-ce5b-4e73-9ea7-89207dbdad0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:25.703516 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-41195cef-ce5b-4e73-9ea7-89207dbdad0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:25.713847 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-41195cef-ce5b-4e73-9ea7-89207dbdad0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:25.714813 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-41195cef-ce5b-4e73-9ea7-89207dbdad0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:25.715722 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-41195cef-ce5b-4e73-9ea7-89207dbdad0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:25.716445 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-41195cef-ce5b-4e73-9ea7-89207dbdad0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:25.901754 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-698c7ec9-3304-48e2-b87b-09618e97bdf2 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:25.911409 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-698c7ec9-3304-48e2-b87b-09618e97bdf2 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1495 microversion: 2.1 time: 0.458640 Apr 20 18:34:25.912064 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 198/406] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:25 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1495 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:34:25.955494 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-41195cef-ce5b-4e73-9ea7-89207dbdad0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:25.966436 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-41195cef-ce5b-4e73-9ea7-89207dbdad0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.267661 Apr 20 18:34:25.968117 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 209/407] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:25 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:26.056177 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-add4f5d5-b465-441b-b089-b438cd04c3b7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:26.056857 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-add4f5d5-b465-441b-b089-b438cd04c3b7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:26.064913 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-add4f5d5-b465-441b-b089-b438cd04c3b7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:26.065443 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-add4f5d5-b465-441b-b089-b438cd04c3b7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:26.066301 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-add4f5d5-b465-441b-b089-b438cd04c3b7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:26.066795 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-add4f5d5-b465-441b-b089-b438cd04c3b7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:26.294343 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-add4f5d5-b465-441b-b089-b438cd04c3b7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:26.304406 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-add4f5d5-b465-441b-b089-b438cd04c3b7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:26.306114 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-add4f5d5-b465-441b-b089-b438cd04c3b7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:26.307342 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-add4f5d5-b465-441b-b089-b438cd04c3b7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.256440 Apr 20 18:34:26.307977 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 199/408] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:26 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:26.678194 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-dc6089a5-ec3c-48c0-acb8-5e8ed4cbc20e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:26.678874 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-dc6089a5-ec3c-48c0-acb8-5e8ed4cbc20e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:26.687030 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dc6089a5-ec3c-48c0-acb8-5e8ed4cbc20e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:26.687541 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dc6089a5-ec3c-48c0-acb8-5e8ed4cbc20e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:26.688474 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dc6089a5-ec3c-48c0-acb8-5e8ed4cbc20e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:26.688895 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dc6089a5-ec3c-48c0-acb8-5e8ed4cbc20e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:26.918196 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-dc6089a5-ec3c-48c0-acb8-5e8ed4cbc20e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:26.927306 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-dc6089a5-ec3c-48c0-acb8-5e8ed4cbc20e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1316 microversion: 2.1 time: 0.253354 Apr 20 18:34:26.927951 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 210/409] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:26 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1316 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:26.987533 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a8989e8e-b627-40e0-8531-5b861157908c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:26.988201 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a8989e8e-b627-40e0-8531-5b861157908c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:26.996403 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a8989e8e-b627-40e0-8531-5b861157908c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:26.996920 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a8989e8e-b627-40e0-8531-5b861157908c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:26.997829 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a8989e8e-b627-40e0-8531-5b861157908c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:26.998331 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a8989e8e-b627-40e0-8531-5b861157908c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:27.218682 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a8989e8e-b627-40e0-8531-5b861157908c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:27.228345 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a8989e8e-b627-40e0-8531-5b861157908c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.244824 Apr 20 18:34:27.228992 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 200/410] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:26 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:27.327213 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-326d3560-6a76-423b-a17e-2cb060a2acc2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:27.327886 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-326d3560-6a76-423b-a17e-2cb060a2acc2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:27.337345 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-326d3560-6a76-423b-a17e-2cb060a2acc2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:27.337881 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-326d3560-6a76-423b-a17e-2cb060a2acc2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:27.338727 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-326d3560-6a76-423b-a17e-2cb060a2acc2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:27.339283 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-326d3560-6a76-423b-a17e-2cb060a2acc2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:27.568683 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-326d3560-6a76-423b-a17e-2cb060a2acc2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:27.580573 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-326d3560-6a76-423b-a17e-2cb060a2acc2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:27.582322 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-326d3560-6a76-423b-a17e-2cb060a2acc2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:27.583620 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-326d3560-6a76-423b-a17e-2cb060a2acc2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.260578 Apr 20 18:34:27.584270 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 211/411] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:27 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:27.946535 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-24259e3b-fc3f-4818-97f1-0d5db0ef6808 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:27.947281 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-24259e3b-fc3f-4818-97f1-0d5db0ef6808 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:27.956078 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-24259e3b-fc3f-4818-97f1-0d5db0ef6808 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:27.956596 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-24259e3b-fc3f-4818-97f1-0d5db0ef6808 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:27.957507 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-24259e3b-fc3f-4818-97f1-0d5db0ef6808 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:27.958015 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-24259e3b-fc3f-4818-97f1-0d5db0ef6808 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:28.186746 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-24259e3b-fc3f-4818-97f1-0d5db0ef6808 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:28.196215 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-24259e3b-fc3f-4818-97f1-0d5db0ef6808 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1316 microversion: 2.1 time: 0.253915 Apr 20 18:34:28.197147 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 201/412] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:27 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1316 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:28.247450 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a99d8fb1-fbf0-4a57-96e4-58b63b97830b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:28.248167 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a99d8fb1-fbf0-4a57-96e4-58b63b97830b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:28.256849 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a99d8fb1-fbf0-4a57-96e4-58b63b97830b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:28.257037 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a99d8fb1-fbf0-4a57-96e4-58b63b97830b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:28.257924 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a99d8fb1-fbf0-4a57-96e4-58b63b97830b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:28.258431 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a99d8fb1-fbf0-4a57-96e4-58b63b97830b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:28.482850 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a99d8fb1-fbf0-4a57-96e4-58b63b97830b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:28.493133 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a99d8fb1-fbf0-4a57-96e4-58b63b97830b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.249720 Apr 20 18:34:28.493827 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 212/413] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:28 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:28.603978 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-08c7eb50-86e1-4ed6-b6c6-ad4650796aeb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:28.604641 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-08c7eb50-86e1-4ed6-b6c6-ad4650796aeb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:28.613077 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-08c7eb50-86e1-4ed6-b6c6-ad4650796aeb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:28.613615 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-08c7eb50-86e1-4ed6-b6c6-ad4650796aeb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:28.614449 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-08c7eb50-86e1-4ed6-b6c6-ad4650796aeb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:28.614940 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-08c7eb50-86e1-4ed6-b6c6-ad4650796aeb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:28.846368 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-08c7eb50-86e1-4ed6-b6c6-ad4650796aeb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:28.857972 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-08c7eb50-86e1-4ed6-b6c6-ad4650796aeb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:28.859660 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-08c7eb50-86e1-4ed6-b6c6-ad4650796aeb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:28.860907 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-08c7eb50-86e1-4ed6-b6c6-ad4650796aeb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.261250 Apr 20 18:34:28.861766 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 202/414] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:28 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:29.214889 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e471c9e3-7daa-4346-aade-a3ecf20db53f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:29.215555 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e471c9e3-7daa-4346-aade-a3ecf20db53f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:29.223863 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e471c9e3-7daa-4346-aade-a3ecf20db53f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:29.224363 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e471c9e3-7daa-4346-aade-a3ecf20db53f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:29.225212 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e471c9e3-7daa-4346-aade-a3ecf20db53f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:29.226434 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e471c9e3-7daa-4346-aade-a3ecf20db53f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:29.471613 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e471c9e3-7daa-4346-aade-a3ecf20db53f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:29.481956 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e471c9e3-7daa-4346-aade-a3ecf20db53f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1316 microversion: 2.1 time: 0.271076 Apr 20 18:34:29.482618 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 213/415] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:29 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1316 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:34:29.512583 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7fbe2fdf-dcf6-4b4e-8e4c-2478330e446f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:29.513345 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7fbe2fdf-dcf6-4b4e-8e4c-2478330e446f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:29.521253 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7fbe2fdf-dcf6-4b4e-8e4c-2478330e446f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:29.521809 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7fbe2fdf-dcf6-4b4e-8e4c-2478330e446f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:29.522710 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7fbe2fdf-dcf6-4b4e-8e4c-2478330e446f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:29.523207 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7fbe2fdf-dcf6-4b4e-8e4c-2478330e446f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:29.762845 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7fbe2fdf-dcf6-4b4e-8e4c-2478330e446f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:29.773516 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7fbe2fdf-dcf6-4b4e-8e4c-2478330e446f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.264055 Apr 20 18:34:29.774501 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 203/416] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:29 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:29.880759 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e53b2aa0-719e-4702-880b-cc6de22c9f34 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:29.881457 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e53b2aa0-719e-4702-880b-cc6de22c9f34 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:29.889974 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e53b2aa0-719e-4702-880b-cc6de22c9f34 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:29.890493 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e53b2aa0-719e-4702-880b-cc6de22c9f34 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:29.891347 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e53b2aa0-719e-4702-880b-cc6de22c9f34 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:29.891873 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e53b2aa0-719e-4702-880b-cc6de22c9f34 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:30.102578 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a757338d-fece-43a5-838a-0e0a90802923 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:30.103241 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a757338d-fece-43a5-838a-0e0a90802923 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:30.112184 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a757338d-fece-43a5-838a-0e0a90802923 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:30.112717 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a757338d-fece-43a5-838a-0e0a90802923 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:30.113612 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a757338d-fece-43a5-838a-0e0a90802923 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:30.114490 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a757338d-fece-43a5-838a-0e0a90802923 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:30.124876 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e53b2aa0-719e-4702-880b-cc6de22c9f34 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:30.135486 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e53b2aa0-719e-4702-880b-cc6de22c9f34 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:30.137182 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e53b2aa0-719e-4702-880b-cc6de22c9f34 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:30.138486 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e53b2aa0-719e-4702-880b-cc6de22c9f34 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.262084 Apr 20 18:34:30.139118 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 214/417] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:29 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:30.186681 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a757338d-fece-43a5-838a-0e0a90802923 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Going to try to terminate instance {{(pid=100593) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:34:30.318707 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a757338d-fece-43a5-838a-0e0a90802923 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 204 len: 0 microversion: 2.1 time: 0.220691 Apr 20 18:34:30.320001 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 204/418] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:34:30 2021] DELETE /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:34:30.328684 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-eb5f0b7c-68df-4953-9718-a8e1399e8655 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:30.329363 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-eb5f0b7c-68df-4953-9718-a8e1399e8655 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:30.338986 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eb5f0b7c-68df-4953-9718-a8e1399e8655 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:30.339487 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eb5f0b7c-68df-4953-9718-a8e1399e8655 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:30.340577 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eb5f0b7c-68df-4953-9718-a8e1399e8655 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:30.341080 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eb5f0b7c-68df-4953-9718-a8e1399e8655 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:30.505457 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-80d5d135-011b-4280-8711-f01e901e64ce tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:30.506640 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-80d5d135-011b-4280-8711-f01e901e64ce tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:30.516022 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-80d5d135-011b-4280-8711-f01e901e64ce tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:30.517059 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-80d5d135-011b-4280-8711-f01e901e64ce tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:30.518179 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-80d5d135-011b-4280-8711-f01e901e64ce tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:30.519628 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-80d5d135-011b-4280-8711-f01e901e64ce tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:30.610031 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-eb5f0b7c-68df-4953-9718-a8e1399e8655 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:30.620457 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-eb5f0b7c-68df-4953-9718-a8e1399e8655 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1501 microversion: 2.1 time: 0.295679 Apr 20 18:34:30.621098 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 215/419] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:30 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1501 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:30.761776 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-80d5d135-011b-4280-8711-f01e901e64ce tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:30.771046 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-80d5d135-011b-4280-8711-f01e901e64ce tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1505 microversion: 2.1 time: 0.271400 Apr 20 18:34:30.771694 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 205/420] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:30 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:30.793363 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b285a7b1-6c14-450a-9b81-caca01762400 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:30.794009 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b285a7b1-6c14-450a-9b81-caca01762400 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:30.802213 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b285a7b1-6c14-450a-9b81-caca01762400 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:30.802717 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b285a7b1-6c14-450a-9b81-caca01762400 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:30.804240 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b285a7b1-6c14-450a-9b81-caca01762400 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:30.804807 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b285a7b1-6c14-450a-9b81-caca01762400 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:31.038573 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b285a7b1-6c14-450a-9b81-caca01762400 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:31.049420 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b285a7b1-6c14-450a-9b81-caca01762400 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.260005 Apr 20 18:34:31.050274 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 216/421] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:30 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:31.161186 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6e9a26bf-2a77-45f1-ab09-678b46fe6338 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:31.162283 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6e9a26bf-2a77-45f1-ab09-678b46fe6338 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:31.173191 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6e9a26bf-2a77-45f1-ab09-678b46fe6338 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:31.174686 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6e9a26bf-2a77-45f1-ab09-678b46fe6338 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:31.178249 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6e9a26bf-2a77-45f1-ab09-678b46fe6338 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:31.180228 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6e9a26bf-2a77-45f1-ab09-678b46fe6338 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:31.426777 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6e9a26bf-2a77-45f1-ab09-678b46fe6338 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:31.439454 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6e9a26bf-2a77-45f1-ab09-678b46fe6338 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:31.441420 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6e9a26bf-2a77-45f1-ab09-678b46fe6338 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:31.442706 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6e9a26bf-2a77-45f1-ab09-678b46fe6338 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.286630 Apr 20 18:34:31.443446 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 206/422] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:31 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:31.639292 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f53aef39-7d4d-4152-84d7-1215feb5d7b2 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:31.639963 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f53aef39-7d4d-4152-84d7-1215feb5d7b2 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:31.648744 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f53aef39-7d4d-4152-84d7-1215feb5d7b2 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:31.649254 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f53aef39-7d4d-4152-84d7-1215feb5d7b2 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:31.650154 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f53aef39-7d4d-4152-84d7-1215feb5d7b2 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:31.650648 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f53aef39-7d4d-4152-84d7-1215feb5d7b2 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:31.886771 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f53aef39-7d4d-4152-84d7-1215feb5d7b2 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:31.896017 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f53aef39-7d4d-4152-84d7-1215feb5d7b2 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1501 microversion: 2.1 time: 0.260853 Apr 20 18:34:31.896669 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 217/423] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:31 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1501 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:32.068861 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b2795023-c032-4587-8660-f364f5db58c2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:32.070591 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b2795023-c032-4587-8660-f364f5db58c2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:32.078751 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b2795023-c032-4587-8660-f364f5db58c2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:32.079278 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b2795023-c032-4587-8660-f364f5db58c2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:32.080086 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b2795023-c032-4587-8660-f364f5db58c2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:32.080580 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b2795023-c032-4587-8660-f364f5db58c2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:32.349020 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b2795023-c032-4587-8660-f364f5db58c2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:32.359813 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b2795023-c032-4587-8660-f364f5db58c2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.295053 Apr 20 18:34:32.360471 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 207/424] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:32 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:32.411849 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-67839c3a-e5a3-4cf8-9f57-79fc5a1e3ec2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5246272-a712-46f2-b999-0688ac257186"}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:32.414551 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-67839c3a-e5a3-4cf8-9f57-79fc5a1e3ec2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:32.423418 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-67839c3a-e5a3-4cf8-9f57-79fc5a1e3ec2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:32.424265 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-67839c3a-e5a3-4cf8-9f57-79fc5a1e3ec2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:32.425142 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-67839c3a-e5a3-4cf8-9f57-79fc5a1e3ec2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:32.425687 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-67839c3a-e5a3-4cf8-9f57-79fc5a1e3ec2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:32.468584 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e25edc38-fac7-4d5f-91e9-8c64a159db8d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:32.469791 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e25edc38-fac7-4d5f-91e9-8c64a159db8d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:32.478735 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e25edc38-fac7-4d5f-91e9-8c64a159db8d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:32.479247 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e25edc38-fac7-4d5f-91e9-8c64a159db8d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:32.482801 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e25edc38-fac7-4d5f-91e9-8c64a159db8d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:32.482801 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e25edc38-fac7-4d5f-91e9-8c64a159db8d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:32.710032 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e25edc38-fac7-4d5f-91e9-8c64a159db8d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:32.719776 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e25edc38-fac7-4d5f-91e9-8c64a159db8d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:32.721459 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e25edc38-fac7-4d5f-91e9-8c64a159db8d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:32.722697 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e25edc38-fac7-4d5f-91e9-8c64a159db8d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.261205 Apr 20 18:34:32.723320 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 208/425] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:32 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:34:32.915436 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e4b5ebd6-49d2-46e9-96d2-5f4a6c671029 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:32.916101 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e4b5ebd6-49d2-46e9-96d2-5f4a6c671029 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:32.924192 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e4b5ebd6-49d2-46e9-96d2-5f4a6c671029 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:32.924699 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e4b5ebd6-49d2-46e9-96d2-5f4a6c671029 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:32.925596 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e4b5ebd6-49d2-46e9-96d2-5f4a6c671029 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:32.926102 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e4b5ebd6-49d2-46e9-96d2-5f4a6c671029 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:33.152001 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e4b5ebd6-49d2-46e9-96d2-5f4a6c671029 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:33.161078 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e4b5ebd6-49d2-46e9-96d2-5f4a6c671029 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1501 microversion: 2.1 time: 0.250257 Apr 20 18:34:33.161776 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 209/426] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:32 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1501 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:34:33.378512 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9c475904-9898-43ca-81d2-3801e3465ff0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:33.379187 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9c475904-9898-43ca-81d2-3801e3465ff0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:33.387877 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9c475904-9898-43ca-81d2-3801e3465ff0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:33.388386 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9c475904-9898-43ca-81d2-3801e3465ff0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:33.389240 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9c475904-9898-43ca-81d2-3801e3465ff0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:33.389769 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9c475904-9898-43ca-81d2-3801e3465ff0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:33.627370 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9c475904-9898-43ca-81d2-3801e3465ff0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:33.637621 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9c475904-9898-43ca-81d2-3801e3465ff0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.263071 Apr 20 18:34:33.638206 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 210/427] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:33 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:34:33.743920 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-113452e5-7eae-40f2-b265-90fcd0941ee1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:33.744590 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-113452e5-7eae-40f2-b265-90fcd0941ee1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:33.752522 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-113452e5-7eae-40f2-b265-90fcd0941ee1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:33.753043 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-113452e5-7eae-40f2-b265-90fcd0941ee1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:33.753922 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-113452e5-7eae-40f2-b265-90fcd0941ee1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:33.754420 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-113452e5-7eae-40f2-b265-90fcd0941ee1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:33.982057 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-113452e5-7eae-40f2-b265-90fcd0941ee1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:33.993869 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-113452e5-7eae-40f2-b265-90fcd0941ee1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:33.995588 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-113452e5-7eae-40f2-b265-90fcd0941ee1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:33.996851 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-113452e5-7eae-40f2-b265-90fcd0941ee1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.257708 Apr 20 18:34:33.997524 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 211/428] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:33 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:34:34.180345 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-86e1ef50-2323-45a3-a7c8-b7251d5e141d tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:34.180931 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-86e1ef50-2323-45a3-a7c8-b7251d5e141d tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:34.188884 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-86e1ef50-2323-45a3-a7c8-b7251d5e141d tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:34.189407 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-86e1ef50-2323-45a3-a7c8-b7251d5e141d tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:34.190261 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-86e1ef50-2323-45a3-a7c8-b7251d5e141d tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:34.190750 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-86e1ef50-2323-45a3-a7c8-b7251d5e141d tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:34.425677 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-86e1ef50-2323-45a3-a7c8-b7251d5e141d tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:34.436286 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-86e1ef50-2323-45a3-a7c8-b7251d5e141d tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1501 microversion: 2.1 time: 0.260195 Apr 20 18:34:34.437039 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 212/429] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:34 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1501 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:34:34.656455 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3e88d441-36be-46a8-9076-99451e609bc0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:34.657124 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3e88d441-36be-46a8-9076-99451e609bc0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:34.665680 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3e88d441-36be-46a8-9076-99451e609bc0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:34.666199 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3e88d441-36be-46a8-9076-99451e609bc0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:34.667056 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3e88d441-36be-46a8-9076-99451e609bc0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:34.667565 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3e88d441-36be-46a8-9076-99451e609bc0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:34.889529 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3e88d441-36be-46a8-9076-99451e609bc0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:34.899737 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3e88d441-36be-46a8-9076-99451e609bc0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.247330 Apr 20 18:34:34.900457 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 213/430] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:34 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:34:35.017851 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-86042ffc-23e9-4007-af09-0dc0a63da8b6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:35.018542 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-86042ffc-23e9-4007-af09-0dc0a63da8b6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:35.027170 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-86042ffc-23e9-4007-af09-0dc0a63da8b6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:35.027731 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-86042ffc-23e9-4007-af09-0dc0a63da8b6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:35.029196 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-86042ffc-23e9-4007-af09-0dc0a63da8b6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:35.029196 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-86042ffc-23e9-4007-af09-0dc0a63da8b6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:35.395746 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-86042ffc-23e9-4007-af09-0dc0a63da8b6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:35.407251 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-86042ffc-23e9-4007-af09-0dc0a63da8b6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:35.408936 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-86042ffc-23e9-4007-af09-0dc0a63da8b6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:35.410311 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-86042ffc-23e9-4007-af09-0dc0a63da8b6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.396610 Apr 20 18:34:35.411131 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 214/431] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:35 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:35.455289 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-dee433a6-ff62-4b4b-a74d-08199beaae9b tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:35.455992 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-dee433a6-ff62-4b4b-a74d-08199beaae9b tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:35.464568 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dee433a6-ff62-4b4b-a74d-08199beaae9b tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:35.465205 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dee433a6-ff62-4b4b-a74d-08199beaae9b tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:35.466090 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dee433a6-ff62-4b4b-a74d-08199beaae9b tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:35.466590 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dee433a6-ff62-4b4b-a74d-08199beaae9b tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:35.734096 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-dee433a6-ff62-4b4b-a74d-08199beaae9b tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:35.748597 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-dee433a6-ff62-4b4b-a74d-08199beaae9b tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1501 microversion: 2.1 time: 0.297501 Apr 20 18:34:35.749423 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 215/432] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:35 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1501 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:34:35.759754 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-67839c3a-e5a3-4cf8-9f57-79fc5a1e3ec2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "POST /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.351841 Apr 20 18:34:35.760445 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 218/433] 10.222.0.25 () {60 vars in 1313 bytes} [Tue Apr 20 18:34:32 2021] POST /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005/os-volume_attachments => generated 194 bytes in 3354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:34:35.923143 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-868cb763-abbc-4d5c-9b7c-95d12327a086 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:35.924382 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-868cb763-abbc-4d5c-9b7c-95d12327a086 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:35.941441 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-868cb763-abbc-4d5c-9b7c-95d12327a086 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:35.942325 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-868cb763-abbc-4d5c-9b7c-95d12327a086 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:35.943885 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-868cb763-abbc-4d5c-9b7c-95d12327a086 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:35.945423 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-868cb763-abbc-4d5c-9b7c-95d12327a086 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:36.264557 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-868cb763-abbc-4d5c-9b7c-95d12327a086 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:36.275177 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-868cb763-abbc-4d5c-9b7c-95d12327a086 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.360539 Apr 20 18:34:36.275809 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 216/434] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:35 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:36.431823 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-46a5c13e-7913-4dd1-b831-a53ed4d70161 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:36.432616 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-46a5c13e-7913-4dd1-b831-a53ed4d70161 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:36.445868 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-46a5c13e-7913-4dd1-b831-a53ed4d70161 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:36.446652 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-46a5c13e-7913-4dd1-b831-a53ed4d70161 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:36.447994 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-46a5c13e-7913-4dd1-b831-a53ed4d70161 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:36.448876 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-46a5c13e-7913-4dd1-b831-a53ed4d70161 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:36.693636 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-46a5c13e-7913-4dd1-b831-a53ed4d70161 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:36.703816 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-46a5c13e-7913-4dd1-b831-a53ed4d70161 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:36.705533 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-46a5c13e-7913-4dd1-b831-a53ed4d70161 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:36.706794 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-46a5c13e-7913-4dd1-b831-a53ed4d70161 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.279870 Apr 20 18:34:36.707453 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 219/435] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:36 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:36.766119 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5adff094-86fb-4cf3-8572-e19ef52d9d59 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:36.766791 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5adff094-86fb-4cf3-8572-e19ef52d9d59 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:36.775654 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5adff094-86fb-4cf3-8572-e19ef52d9d59 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:36.776160 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5adff094-86fb-4cf3-8572-e19ef52d9d59 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:36.777018 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5adff094-86fb-4cf3-8572-e19ef52d9d59 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:36.777528 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5adff094-86fb-4cf3-8572-e19ef52d9d59 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:37.007503 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5adff094-86fb-4cf3-8572-e19ef52d9d59 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:37.016791 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5adff094-86fb-4cf3-8572-e19ef52d9d59 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1501 microversion: 2.1 time: 0.254554 Apr 20 18:34:37.017422 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 217/436] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:36 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1501 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:37.293876 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7d58316f-3dac-47ae-a03d-67ea7ad17c12 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:37.294832 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7d58316f-3dac-47ae-a03d-67ea7ad17c12 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:37.304227 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7d58316f-3dac-47ae-a03d-67ea7ad17c12 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:37.304946 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7d58316f-3dac-47ae-a03d-67ea7ad17c12 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:37.306060 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7d58316f-3dac-47ae-a03d-67ea7ad17c12 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:37.306641 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7d58316f-3dac-47ae-a03d-67ea7ad17c12 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:37.567598 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7d58316f-3dac-47ae-a03d-67ea7ad17c12 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:37.578499 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7d58316f-3dac-47ae-a03d-67ea7ad17c12 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.289163 Apr 20 18:34:37.579157 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 220/437] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:37 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:37.729213 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-98f3c639-edd4-48d2-950d-eed68c652943 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:37.729918 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-98f3c639-edd4-48d2-950d-eed68c652943 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:37.739030 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-98f3c639-edd4-48d2-950d-eed68c652943 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:37.739542 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-98f3c639-edd4-48d2-950d-eed68c652943 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:37.740403 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-98f3c639-edd4-48d2-950d-eed68c652943 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:37.741767 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-98f3c639-edd4-48d2-950d-eed68c652943 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:37.977433 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-98f3c639-edd4-48d2-950d-eed68c652943 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:37.987903 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-98f3c639-edd4-48d2-950d-eed68c652943 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:37.989815 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-98f3c639-edd4-48d2-950d-eed68c652943 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:37.992410 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-98f3c639-edd4-48d2-950d-eed68c652943 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.266738 Apr 20 18:34:37.993215 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 218/438] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:37 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:38.037736 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c1544b22-b94a-4c8f-88a5-2addbe3f6950 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:38.039132 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c1544b22-b94a-4c8f-88a5-2addbe3f6950 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:38.047885 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c1544b22-b94a-4c8f-88a5-2addbe3f6950 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:38.048394 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c1544b22-b94a-4c8f-88a5-2addbe3f6950 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:38.049263 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c1544b22-b94a-4c8f-88a5-2addbe3f6950 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:38.049794 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c1544b22-b94a-4c8f-88a5-2addbe3f6950 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:38.431217 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c1544b22-b94a-4c8f-88a5-2addbe3f6950 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:38.440283 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c1544b22-b94a-4c8f-88a5-2addbe3f6950 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1501 microversion: 2.1 time: 0.407343 Apr 20 18:34:38.440938 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 221/439] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:38 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1501 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:38.597834 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-be90347e-038d-4ef8-884b-9f885e70d5b1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:38.598503 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-be90347e-038d-4ef8-884b-9f885e70d5b1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:38.607213 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-be90347e-038d-4ef8-884b-9f885e70d5b1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:38.607721 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-be90347e-038d-4ef8-884b-9f885e70d5b1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:38.608572 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-be90347e-038d-4ef8-884b-9f885e70d5b1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:38.609112 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-be90347e-038d-4ef8-884b-9f885e70d5b1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:38.844534 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-be90347e-038d-4ef8-884b-9f885e70d5b1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:38.855223 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-be90347e-038d-4ef8-884b-9f885e70d5b1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.261285 Apr 20 18:34:38.856230 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 219/440] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:38 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:39.016121 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-88d5024e-53d0-4e86-8c47-17f6df4b921a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:39.016896 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-88d5024e-53d0-4e86-8c47-17f6df4b921a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:39.026598 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-88d5024e-53d0-4e86-8c47-17f6df4b921a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:39.027107 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-88d5024e-53d0-4e86-8c47-17f6df4b921a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:39.028009 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-88d5024e-53d0-4e86-8c47-17f6df4b921a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:39.028508 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-88d5024e-53d0-4e86-8c47-17f6df4b921a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:39.398015 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-2044d3db-3af9-4989-af8e-9c51b4787f3c req-9e08aa38-b237-4fcd-a696-79d8c97c3a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c94a1f58-43bf-44d1-bcf5-3811d5910744", "name": "network-vif-unplugged", "status": "completed", "tag": "6116c10b-a2ae-4688-ab93-903ec2d4df45"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:39.404949 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:34:39.404949 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:34:39.446296 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-2044d3db-3af9-4989-af8e-9c51b4787f3c req-9e08aa38-b237-4fcd-a696-79d8c97c3a3b service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:39.447417 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-2044d3db-3af9-4989-af8e-9c51b4787f3c req-9e08aa38-b237-4fcd-a696-79d8c97c3a3b service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:39.493796 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-2044d3db-3af9-4989-af8e-9c51b4787f3c req-9e08aa38-b237-4fcd-a696-79d8c97c3a3b service nova] Creating event network-vif-unplugged:6116c10b-a2ae-4688-ab93-903ec2d4df45 for instance c94a1f58-43bf-44d1-bcf5-3811d5910744 on hv-cinder-78693 Apr 20 18:34:39.511442 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-2044d3db-3af9-4989-af8e-9c51b4787f3c req-9e08aa38-b237-4fcd-a696-79d8c97c3a3b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132838 Apr 20 18:34:39.513613 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 220/441] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:34:39 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:34:39.533641 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-045dc172-4f0c-47f2-b790-bd9692a80945 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:39.535751 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-045dc172-4f0c-47f2-b790-bd9692a80945 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:39.540025 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-88d5024e-53d0-4e86-8c47-17f6df4b921a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:39.551734 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-045dc172-4f0c-47f2-b790-bd9692a80945 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:39.553207 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-045dc172-4f0c-47f2-b790-bd9692a80945 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:39.554213 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-045dc172-4f0c-47f2-b790-bd9692a80945 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:39.554947 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-045dc172-4f0c-47f2-b790-bd9692a80945 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:39.567398 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-88d5024e-53d0-4e86-8c47-17f6df4b921a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:39.570093 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-88d5024e-53d0-4e86-8c47-17f6df4b921a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:39.571584 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-88d5024e-53d0-4e86-8c47-17f6df4b921a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.562130 Apr 20 18:34:39.583929 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 222/442] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:39 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:39.807226 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-045dc172-4f0c-47f2-b790-bd9692a80945 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:39.816585 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-045dc172-4f0c-47f2-b790-bd9692a80945 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1501 microversion: 2.1 time: 0.297773 Apr 20 18:34:39.817219 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 221/443] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:39 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1501 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:39.882914 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5b1b2d67-a408-4438-ae91-6f9815185bb7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:39.883706 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5b1b2d67-a408-4438-ae91-6f9815185bb7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:39.892491 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5b1b2d67-a408-4438-ae91-6f9815185bb7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:39.893114 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5b1b2d67-a408-4438-ae91-6f9815185bb7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:39.894105 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5b1b2d67-a408-4438-ae91-6f9815185bb7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:39.894686 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5b1b2d67-a408-4438-ae91-6f9815185bb7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:40.368232 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5b1b2d67-a408-4438-ae91-6f9815185bb7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:40.383436 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-5b1226f3-d84c-4d05-8d8e-1422196b4dda req-bf9771e7-8f4b-40bb-83ad-75454f3e40b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c94a1f58-43bf-44d1-bcf5-3811d5910744", "name": "network-vif-deleted", "tag": "6116c10b-a2ae-4688-ab93-903ec2d4df45"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:40.388393 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:34:40.388393 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:34:40.392286 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5b1b2d67-a408-4438-ae91-6f9815185bb7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.514102 Apr 20 18:34:40.392958 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 223/444] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:39 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:40.414599 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-5b1226f3-d84c-4d05-8d8e-1422196b4dda req-bf9771e7-8f4b-40bb-83ad-75454f3e40b3 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:40.415116 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-5b1226f3-d84c-4d05-8d8e-1422196b4dda req-bf9771e7-8f4b-40bb-83ad-75454f3e40b3 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:40.435628 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-5b1226f3-d84c-4d05-8d8e-1422196b4dda req-bf9771e7-8f4b-40bb-83ad-75454f3e40b3 service nova] Creating event network-vif-deleted:6116c10b-a2ae-4688-ab93-903ec2d4df45 for instance c94a1f58-43bf-44d1-bcf5-3811d5910744 on hv-cinder-78693 Apr 20 18:34:40.442613 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-5b1226f3-d84c-4d05-8d8e-1422196b4dda req-bf9771e7-8f4b-40bb-83ad-75454f3e40b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069554 Apr 20 18:34:40.443527 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 222/445] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:34:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:34:40.591829 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e4c25bdc-fe6f-4c14-84f3-47005c912aa3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:40.592424 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e4c25bdc-fe6f-4c14-84f3-47005c912aa3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:40.602360 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e4c25bdc-fe6f-4c14-84f3-47005c912aa3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:40.602927 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e4c25bdc-fe6f-4c14-84f3-47005c912aa3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:40.603820 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e4c25bdc-fe6f-4c14-84f3-47005c912aa3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:40.604287 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e4c25bdc-fe6f-4c14-84f3-47005c912aa3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:40.837684 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b4066fe0-75e2-49dd-9c3a-0d6ec2317eff tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:40.838488 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b4066fe0-75e2-49dd-9c3a-0d6ec2317eff tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:40.838871 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e4c25bdc-fe6f-4c14-84f3-47005c912aa3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:40.849338 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e4c25bdc-fe6f-4c14-84f3-47005c912aa3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:40.851671 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e4c25bdc-fe6f-4c14-84f3-47005c912aa3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:40.852994 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e4c25bdc-fe6f-4c14-84f3-47005c912aa3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.265794 Apr 20 18:34:40.853882 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 224/446] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:40 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:40.854424 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b4066fe0-75e2-49dd-9c3a-0d6ec2317eff tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:40.855000 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b4066fe0-75e2-49dd-9c3a-0d6ec2317eff tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:40.856151 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b4066fe0-75e2-49dd-9c3a-0d6ec2317eff tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:40.856660 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b4066fe0-75e2-49dd-9c3a-0d6ec2317eff tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:40.991286 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b4066fe0-75e2-49dd-9c3a-0d6ec2317eff tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:41.000615 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b4066fe0-75e2-49dd-9c3a-0d6ec2317eff tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1459 microversion: 2.1 time: 0.169828 Apr 20 18:34:41.001266 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 223/447] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:40 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1459 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:41.417142 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-65e61a14-9b7c-458b-a070-c8ac773dcfd8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:41.418454 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-65e61a14-9b7c-458b-a070-c8ac773dcfd8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:41.431948 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-65e61a14-9b7c-458b-a070-c8ac773dcfd8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:41.432463 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-65e61a14-9b7c-458b-a070-c8ac773dcfd8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:41.433324 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-65e61a14-9b7c-458b-a070-c8ac773dcfd8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:41.433849 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-65e61a14-9b7c-458b-a070-c8ac773dcfd8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:41.671731 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-65e61a14-9b7c-458b-a070-c8ac773dcfd8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:41.682234 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-65e61a14-9b7c-458b-a070-c8ac773dcfd8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.273679 Apr 20 18:34:41.682895 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 225/448] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:41 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:41.873761 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ecf0893c-d282-42ed-9e19-edf8fa1311bd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:41.874423 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ecf0893c-d282-42ed-9e19-edf8fa1311bd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:41.882332 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ecf0893c-d282-42ed-9e19-edf8fa1311bd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:41.882842 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ecf0893c-d282-42ed-9e19-edf8fa1311bd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:41.883681 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ecf0893c-d282-42ed-9e19-edf8fa1311bd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:41.884167 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ecf0893c-d282-42ed-9e19-edf8fa1311bd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:42.020802 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e696ee13-147b-4dab-8019-939318afee2f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:42.021496 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e696ee13-147b-4dab-8019-939318afee2f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:42.030654 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e696ee13-147b-4dab-8019-939318afee2f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:42.031159 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e696ee13-147b-4dab-8019-939318afee2f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:42.032024 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e696ee13-147b-4dab-8019-939318afee2f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:42.032514 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e696ee13-147b-4dab-8019-939318afee2f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:42.110841 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ecf0893c-d282-42ed-9e19-edf8fa1311bd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:42.122122 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ecf0893c-d282-42ed-9e19-edf8fa1311bd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:42.124116 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ecf0893c-d282-42ed-9e19-edf8fa1311bd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:42.125372 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ecf0893c-d282-42ed-9e19-edf8fa1311bd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.255842 Apr 20 18:34:42.126026 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 224/449] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:41 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:42.186359 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e696ee13-147b-4dab-8019-939318afee2f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:42.196555 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e696ee13-147b-4dab-8019-939318afee2f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1459 microversion: 2.1 time: 0.179904 Apr 20 18:34:42.197207 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 226/450] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:42 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1459 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:42.701708 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0eb9bb2e-ebc2-4309-b26e-5bc089ecfd2b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:42.702443 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0eb9bb2e-ebc2-4309-b26e-5bc089ecfd2b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:42.711405 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0eb9bb2e-ebc2-4309-b26e-5bc089ecfd2b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:42.711922 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0eb9bb2e-ebc2-4309-b26e-5bc089ecfd2b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:42.713023 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0eb9bb2e-ebc2-4309-b26e-5bc089ecfd2b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:42.713565 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0eb9bb2e-ebc2-4309-b26e-5bc089ecfd2b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:42.937705 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0eb9bb2e-ebc2-4309-b26e-5bc089ecfd2b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:42.947413 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0eb9bb2e-ebc2-4309-b26e-5bc089ecfd2b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.249667 Apr 20 18:34:42.948058 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 225/451] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:42 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:43.146654 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2bd1e9fb-1503-4282-b52b-13ad5e08bbdb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:43.147347 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2bd1e9fb-1503-4282-b52b-13ad5e08bbdb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:43.156140 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2bd1e9fb-1503-4282-b52b-13ad5e08bbdb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:43.156655 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2bd1e9fb-1503-4282-b52b-13ad5e08bbdb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:43.157588 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2bd1e9fb-1503-4282-b52b-13ad5e08bbdb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:43.158035 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2bd1e9fb-1503-4282-b52b-13ad5e08bbdb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:43.214914 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-aec4038f-2ca8-4e0d-aa83-3bd749619b22 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:43.215562 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-aec4038f-2ca8-4e0d-aa83-3bd749619b22 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:43.223752 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-aec4038f-2ca8-4e0d-aa83-3bd749619b22 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:43.224306 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-aec4038f-2ca8-4e0d-aa83-3bd749619b22 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:43.225713 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-aec4038f-2ca8-4e0d-aa83-3bd749619b22 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:43.226198 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-aec4038f-2ca8-4e0d-aa83-3bd749619b22 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:43.304174 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-aec4038f-2ca8-4e0d-aa83-3bd749619b22 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:43.304992 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-aec4038f-2ca8-4e0d-aa83-3bd749619b22 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:43.305271 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-aec4038f-2ca8-4e0d-aa83-3bd749619b22 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lazy-loading 'fault' on Instance uuid c94a1f58-43bf-44d1-bcf5-3811d5910744 {{(pid=100593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:34:43.374174 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-aec4038f-2ca8-4e0d-aa83-3bd749619b22 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:43.386102 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-aec4038f-2ca8-4e0d-aa83-3bd749619b22 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 200 len: 1303 microversion: 2.1 time: 0.175198 Apr 20 18:34:43.386991 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 226/452] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:43 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 1303 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:43.387912 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2bd1e9fb-1503-4282-b52b-13ad5e08bbdb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:43.397876 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2bd1e9fb-1503-4282-b52b-13ad5e08bbdb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:43.399804 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2bd1e9fb-1503-4282-b52b-13ad5e08bbdb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:43.401227 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2bd1e9fb-1503-4282-b52b-13ad5e08bbdb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.258863 Apr 20 18:34:43.402314 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 227/453] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:43 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:43.965910 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ac2da337-0763-4f38-95bc-a23ee9d10cfa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:43.966506 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ac2da337-0763-4f38-95bc-a23ee9d10cfa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:43.974567 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ac2da337-0763-4f38-95bc-a23ee9d10cfa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:43.975726 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ac2da337-0763-4f38-95bc-a23ee9d10cfa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:43.976600 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ac2da337-0763-4f38-95bc-a23ee9d10cfa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:43.977094 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ac2da337-0763-4f38-95bc-a23ee9d10cfa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:44.225900 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ac2da337-0763-4f38-95bc-a23ee9d10cfa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:44.235912 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ac2da337-0763-4f38-95bc-a23ee9d10cfa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.274090 Apr 20 18:34:44.236660 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 227/454] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:43 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:44.405190 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2829628b-e996-4153-8aee-69831e348577 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:44.405892 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2829628b-e996-4153-8aee-69831e348577 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: c94a1f58-43bf-44d1-bcf5-3811d5910744] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:44.414074 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2829628b-e996-4153-8aee-69831e348577 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:44.414593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2829628b-e996-4153-8aee-69831e348577 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:44.415456 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2829628b-e996-4153-8aee-69831e348577 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:44.415954 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2829628b-e996-4153-8aee-69831e348577 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:44.422081 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c178e5d8-ff76-4e86-ab7a-4c3b4a314499 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:44.423035 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c178e5d8-ff76-4e86-ab7a-4c3b4a314499 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:44.431889 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c178e5d8-ff76-4e86-ab7a-4c3b4a314499 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:44.432391 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c178e5d8-ff76-4e86-ab7a-4c3b4a314499 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:44.433476 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c178e5d8-ff76-4e86-ab7a-4c3b4a314499 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:44.433970 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c178e5d8-ff76-4e86-ab7a-4c3b4a314499 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:44.476989 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-2829628b-e996-4153-8aee-69831e348577 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] HTTP exception thrown: Instance c94a1f58-43bf-44d1-bcf5-3811d5910744 could not be found. Apr 20 18:34:44.477607 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2829628b-e996-4153-8aee-69831e348577 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Returning 404 to user: Instance c94a1f58-43bf-44d1-bcf5-3811d5910744 could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:34:44.478539 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2829628b-e996-4153-8aee-69831e348577 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744" status: 404 len: 111 microversion: 2.1 time: 0.077769 Apr 20 18:34:44.479396 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 228/455] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:44 2021] GET /compute/v2.1/servers/c94a1f58-43bf-44d1-bcf5-3811d5910744 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:34:44.613241 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-27853d20-20d6-4ba2-b930-d77d4c22e236 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-161910524", "imageRef": "ba8326d8-5d1b-42a2-a65e-f1108a025e30", "flavorRef": "452", "networks": [{"uuid": "c8c07f4f-8832-4bd2-8650-ac17f6efb3d3"}]}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:44.671107 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c178e5d8-ff76-4e86-ab7a-4c3b4a314499 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:44.685259 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c178e5d8-ff76-4e86-ab7a-4c3b4a314499 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:44.687170 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c178e5d8-ff76-4e86-ab7a-4c3b4a314499 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:44.688002 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c178e5d8-ff76-4e86-ab7a-4c3b4a314499 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.270276 Apr 20 18:34:44.688779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 228/456] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:44 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:44.692745 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.network.neutron [None req-27853d20-20d6-4ba2-b930-d77d4c22e236 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] validate_networks() for [('c8c07f4f-8832-4bd2-8650-ac17f6efb3d3', None, None, None)] {{(pid=100592) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:34:45.255733 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f88ed76b-9468-4fe7-bb0e-f1066fdec527 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:45.257484 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f88ed76b-9468-4fe7-bb0e-f1066fdec527 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:45.265729 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f88ed76b-9468-4fe7-bb0e-f1066fdec527 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:45.266247 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f88ed76b-9468-4fe7-bb0e-f1066fdec527 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:45.267157 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f88ed76b-9468-4fe7-bb0e-f1066fdec527 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:45.267817 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f88ed76b-9468-4fe7-bb0e-f1066fdec527 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:45.289356 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-27853d20-20d6-4ba2-b930-d77d4c22e236 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Flavor limits 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:34:45.290613 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-27853d20-20d6-4ba2-b930-d77d4c22e236 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Image limits 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:34:45.291297 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-27853d20-20d6-4ba2-b930-d77d4c22e236 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Flavor pref 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:34:45.291874 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-27853d20-20d6-4ba2-b930-d77d4c22e236 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Image pref 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:34:45.292583 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-27853d20-20d6-4ba2-b930-d77d4c22e236 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:34:45.302492 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-27853d20-20d6-4ba2-b930-d77d4c22e236 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:45.304046 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-27853d20-20d6-4ba2-b930-d77d4c22e236 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:45.305184 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-27853d20-20d6-4ba2-b930-d77d4c22e236 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:45.305713 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-27853d20-20d6-4ba2-b930-d77d4c22e236 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:45.331394 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-27853d20-20d6-4ba2-b930-d77d4c22e236 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Getting quotas for project 977d101190a341ceb8e52a3b3e91678f. Resources: {'instances', 'ram', 'cores'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:34:45.336647 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-27853d20-20d6-4ba2-b930-d77d4c22e236 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Getting quotas for user aa06da535517426ca314d698b0067e4d and project 977d101190a341ceb8e52a3b3e91678f. Resources: {'instances', 'ram', 'cores'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:34:45.349850 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-27853d20-20d6-4ba2-b930-d77d4c22e236 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Going to run 1 instances... {{(pid=100592) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:34:45.352543 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-27853d20-20d6-4ba2-b930-d77d4c22e236 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba8326d8-5d1b-42a2-a65e-f1108a025e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100592) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:34:45.423234 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-27853d20-20d6-4ba2-b930-d77d4c22e236 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.813614 Apr 20 18:34:45.423940 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 229/457] 10.222.0.25 () {60 vars in 1137 bytes} [Tue Apr 20 18:34:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:34:45.435415 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-fb3eabd0-efe9-439e-a271-83ee2a0a0369 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:45.436089 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-fb3eabd0-efe9-439e-a271-83ee2a0a0369 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:45.523243 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-fb3eabd0-efe9-439e-a271-83ee2a0a0369 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:45.528017 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f88ed76b-9468-4fe7-bb0e-f1066fdec527 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:45.531891 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-fb3eabd0-efe9-439e-a271-83ee2a0a0369 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235" status: 200 len: 1213 microversion: 2.1 time: 0.101254 Apr 20 18:34:45.532754 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 230/458] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:45 2021] GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235 => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:45.538750 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f88ed76b-9468-4fe7-bb0e-f1066fdec527 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.286719 Apr 20 18:34:45.539568 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 229/459] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:45 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:45.708685 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-02821e06-e7c9-473e-ad70-ea2064823524 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:45.710183 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-02821e06-e7c9-473e-ad70-ea2064823524 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:45.718452 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-02821e06-e7c9-473e-ad70-ea2064823524 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:45.718960 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-02821e06-e7c9-473e-ad70-ea2064823524 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:45.719813 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-02821e06-e7c9-473e-ad70-ea2064823524 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:45.720309 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-02821e06-e7c9-473e-ad70-ea2064823524 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:45.949249 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-02821e06-e7c9-473e-ad70-ea2064823524 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:45.965786 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-02821e06-e7c9-473e-ad70-ea2064823524 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:45.967080 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-02821e06-e7c9-473e-ad70-ea2064823524 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:45.968746 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-02821e06-e7c9-473e-ad70-ea2064823524 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.264297 Apr 20 18:34:45.969565 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 231/460] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:45 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:46.550512 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-95da8729-9d6a-4479-94cf-3b0bd3a96bf6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:46.551198 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-95da8729-9d6a-4479-94cf-3b0bd3a96bf6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:46.556931 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-137acc3a-68b3-45f6-a93d-9367d50e239e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:46.557636 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-137acc3a-68b3-45f6-a93d-9367d50e239e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:46.559929 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-95da8729-9d6a-4479-94cf-3b0bd3a96bf6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:46.560380 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-95da8729-9d6a-4479-94cf-3b0bd3a96bf6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:46.561213 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-95da8729-9d6a-4479-94cf-3b0bd3a96bf6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:46.561746 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-95da8729-9d6a-4479-94cf-3b0bd3a96bf6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:46.566890 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-137acc3a-68b3-45f6-a93d-9367d50e239e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:46.567403 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-137acc3a-68b3-45f6-a93d-9367d50e239e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:46.568277 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-137acc3a-68b3-45f6-a93d-9367d50e239e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:46.569353 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-137acc3a-68b3-45f6-a93d-9367d50e239e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:46.699383 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-95da8729-9d6a-4479-94cf-3b0bd3a96bf6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:46.708800 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-95da8729-9d6a-4479-94cf-3b0bd3a96bf6 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235" status: 200 len: 1217 microversion: 2.1 time: 0.162230 Apr 20 18:34:46.709666 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 230/461] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:46 2021] GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235 => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:46.797075 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-137acc3a-68b3-45f6-a93d-9367d50e239e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:46.807022 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-137acc3a-68b3-45f6-a93d-9367d50e239e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.254579 Apr 20 18:34:46.807671 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 232/462] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:46 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:46.990455 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1ae0e11a-1670-44bf-918b-b4cb88e38295 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:46.992261 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1ae0e11a-1670-44bf-918b-b4cb88e38295 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:47.001056 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1ae0e11a-1670-44bf-918b-b4cb88e38295 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:47.001603 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1ae0e11a-1670-44bf-918b-b4cb88e38295 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:47.002481 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1ae0e11a-1670-44bf-918b-b4cb88e38295 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:47.003015 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1ae0e11a-1670-44bf-918b-b4cb88e38295 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:47.239899 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1ae0e11a-1670-44bf-918b-b4cb88e38295 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:47.250373 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1ae0e11a-1670-44bf-918b-b4cb88e38295 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:47.251992 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1ae0e11a-1670-44bf-918b-b4cb88e38295 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:47.253243 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1ae0e11a-1670-44bf-918b-b4cb88e38295 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.267231 Apr 20 18:34:47.253904 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 231/463] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:46 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:47.728692 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a21df61b-1fc8-4824-9ab0-b05cc50d058b tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:47.729513 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a21df61b-1fc8-4824-9ab0-b05cc50d058b tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:47.738112 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a21df61b-1fc8-4824-9ab0-b05cc50d058b tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:47.738634 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a21df61b-1fc8-4824-9ab0-b05cc50d058b tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:47.739507 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a21df61b-1fc8-4824-9ab0-b05cc50d058b tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:47.740009 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a21df61b-1fc8-4824-9ab0-b05cc50d058b tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:47.837997 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-21ce7bfc-f0f0-45d0-8cd5-51885f59345e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:47.838664 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-21ce7bfc-f0f0-45d0-8cd5-51885f59345e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:47.846905 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-21ce7bfc-f0f0-45d0-8cd5-51885f59345e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:47.847414 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-21ce7bfc-f0f0-45d0-8cd5-51885f59345e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:47.848266 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-21ce7bfc-f0f0-45d0-8cd5-51885f59345e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:47.848752 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-21ce7bfc-f0f0-45d0-8cd5-51885f59345e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:47.873548 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a21df61b-1fc8-4824-9ab0-b05cc50d058b tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:47.884497 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a21df61b-1fc8-4824-9ab0-b05cc50d058b tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235" status: 200 len: 1209 microversion: 2.1 time: 0.160609 Apr 20 18:34:47.885134 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 233/464] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:47 2021] GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235 => generated 1209 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:48.123065 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-21ce7bfc-f0f0-45d0-8cd5-51885f59345e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:48.133705 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-21ce7bfc-f0f0-45d0-8cd5-51885f59345e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.300466 Apr 20 18:34:48.134386 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 232/465] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:47 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:48.275111 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8f408aeb-7b67-4272-b163-fdbac5507d00 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:48.275969 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8f408aeb-7b67-4272-b163-fdbac5507d00 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:48.288168 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8f408aeb-7b67-4272-b163-fdbac5507d00 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:48.288763 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8f408aeb-7b67-4272-b163-fdbac5507d00 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:48.289728 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8f408aeb-7b67-4272-b163-fdbac5507d00 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:48.290284 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8f408aeb-7b67-4272-b163-fdbac5507d00 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:48.919886 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b5985110-8938-4084-9259-65e25fca85dd tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:48.920604 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b5985110-8938-4084-9259-65e25fca85dd tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:48.927443 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8f408aeb-7b67-4272-b163-fdbac5507d00 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:48.931378 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b5985110-8938-4084-9259-65e25fca85dd tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:48.932079 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b5985110-8938-4084-9259-65e25fca85dd tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:48.933045 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b5985110-8938-4084-9259-65e25fca85dd tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:48.933940 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b5985110-8938-4084-9259-65e25fca85dd tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:48.946639 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8f408aeb-7b67-4272-b163-fdbac5507d00 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:48.948394 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8f408aeb-7b67-4272-b163-fdbac5507d00 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:48.949763 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8f408aeb-7b67-4272-b163-fdbac5507d00 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1743 microversion: 2.20 time: 0.680843 Apr 20 18:34:48.950405 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 234/466] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:48 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1743 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:49.079338 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b5985110-8938-4084-9259-65e25fca85dd tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:49.090250 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b5985110-8938-4084-9259-65e25fca85dd tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235" status: 200 len: 1283 microversion: 2.1 time: 0.179488 Apr 20 18:34:49.091250 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 233/467] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:48 2021] GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235 => generated 1283 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:34:49.152870 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-21761740-2fd5-4523-9691-ec2cf37e2ba8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:49.153614 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-21761740-2fd5-4523-9691-ec2cf37e2ba8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:49.161942 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-21761740-2fd5-4523-9691-ec2cf37e2ba8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:49.162962 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-21761740-2fd5-4523-9691-ec2cf37e2ba8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:49.163830 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-21761740-2fd5-4523-9691-ec2cf37e2ba8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:49.164332 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-21761740-2fd5-4523-9691-ec2cf37e2ba8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:49.567722 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-21761740-2fd5-4523-9691-ec2cf37e2ba8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:49.582117 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-21761740-2fd5-4523-9691-ec2cf37e2ba8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.433724 Apr 20 18:34:49.582785 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 235/468] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:49 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:49.975482 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-22fd4b37-5dfd-4f3a-9fe2-19344f0bbf02 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:49.976439 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-22fd4b37-5dfd-4f3a-9fe2-19344f0bbf02 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:49.986289 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-22fd4b37-5dfd-4f3a-9fe2-19344f0bbf02 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:49.987577 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-22fd4b37-5dfd-4f3a-9fe2-19344f0bbf02 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:49.988645 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-22fd4b37-5dfd-4f3a-9fe2-19344f0bbf02 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:49.989287 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-22fd4b37-5dfd-4f3a-9fe2-19344f0bbf02 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:50.110476 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7ce7a22d-58f9-4c42-a92c-53bfd8acb897 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:50.111406 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7ce7a22d-58f9-4c42-a92c-53bfd8acb897 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:50.121687 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7ce7a22d-58f9-4c42-a92c-53bfd8acb897 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:50.122550 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7ce7a22d-58f9-4c42-a92c-53bfd8acb897 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:50.124045 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7ce7a22d-58f9-4c42-a92c-53bfd8acb897 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:50.125036 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7ce7a22d-58f9-4c42-a92c-53bfd8acb897 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:50.288622 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-22fd4b37-5dfd-4f3a-9fe2-19344f0bbf02 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:50.301145 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-22fd4b37-5dfd-4f3a-9fe2-19344f0bbf02 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:50.303604 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-22fd4b37-5dfd-4f3a-9fe2-19344f0bbf02 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:50.304991 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-22fd4b37-5dfd-4f3a-9fe2-19344f0bbf02 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1743 microversion: 2.20 time: 0.334472 Apr 20 18:34:50.305781 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 234/469] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:49 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1743 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:50.562064 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7ce7a22d-58f9-4c42-a92c-53bfd8acb897 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:50.573173 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7ce7a22d-58f9-4c42-a92c-53bfd8acb897 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235" status: 200 len: 1313 microversion: 2.1 time: 0.467567 Apr 20 18:34:50.574052 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 236/470] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:50 2021] GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235 => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:34:50.601833 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3040729f-9059-4a62-a530-df4a9a114afa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:50.602897 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3040729f-9059-4a62-a530-df4a9a114afa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:50.614407 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3040729f-9059-4a62-a530-df4a9a114afa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:50.615361 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3040729f-9059-4a62-a530-df4a9a114afa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:50.617796 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3040729f-9059-4a62-a530-df4a9a114afa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:50.618564 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3040729f-9059-4a62-a530-df4a9a114afa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:50.927597 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3040729f-9059-4a62-a530-df4a9a114afa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:50.944720 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3040729f-9059-4a62-a530-df4a9a114afa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.348015 Apr 20 18:34:50.947115 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 235/471] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:50 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:51.009347 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-602450da-949c-424a-983e-808616ba293b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:51.010596 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-602450da-949c-424a-983e-808616ba293b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:51.020375 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-602450da-949c-424a-983e-808616ba293b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:51.020892 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-602450da-949c-424a-983e-808616ba293b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:51.022366 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-602450da-949c-424a-983e-808616ba293b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:51.023332 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-602450da-949c-424a-983e-808616ba293b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:51.112156 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-602450da-949c-424a-983e-808616ba293b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lazy-loading 'flavor' on Instance uuid aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:34:51.332471 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9fb27407-ca5c-4d68-b03d-5f8ea1067feb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:51.333662 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9fb27407-ca5c-4d68-b03d-5f8ea1067feb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:51.350441 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9fb27407-ca5c-4d68-b03d-5f8ea1067feb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:51.351757 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9fb27407-ca5c-4d68-b03d-5f8ea1067feb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:51.353760 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9fb27407-ca5c-4d68-b03d-5f8ea1067feb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:51.354681 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9fb27407-ca5c-4d68-b03d-5f8ea1067feb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:51.701913 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-602450da-949c-424a-983e-808616ba293b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "POST /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d/action" status: 200 len: 32 microversion: 2.1 time: 0.698468 Apr 20 18:34:51.702618 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 237/472] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:34:51 2021] POST /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d/action => generated 32 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:34:51.720704 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c0b8d5ec-e636-49d9-8cc4-34a163c04feb tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:51.721798 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c0b8d5ec-e636-49d9-8cc4-34a163c04feb tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:51.735959 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c0b8d5ec-e636-49d9-8cc4-34a163c04feb tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:51.737937 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c0b8d5ec-e636-49d9-8cc4-34a163c04feb tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:51.739570 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c0b8d5ec-e636-49d9-8cc4-34a163c04feb tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:51.739987 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c0b8d5ec-e636-49d9-8cc4-34a163c04feb tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:51.849364 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9fb27407-ca5c-4d68-b03d-5f8ea1067feb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:51.862600 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9fb27407-ca5c-4d68-b03d-5f8ea1067feb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:51.866621 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9fb27407-ca5c-4d68-b03d-5f8ea1067feb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:51.868868 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9fb27407-ca5c-4d68-b03d-5f8ea1067feb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1743 microversion: 2.20 time: 0.546215 Apr 20 18:34:51.870001 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 236/473] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:51 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1743 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:51.875857 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-adb5b683-bad9-4f18-9bea-d48f5922af00 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:51.877111 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-adb5b683-bad9-4f18-9bea-d48f5922af00 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:51.893977 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-adb5b683-bad9-4f18-9bea-d48f5922af00 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:51.895346 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-adb5b683-bad9-4f18-9bea-d48f5922af00 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:51.896443 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-adb5b683-bad9-4f18-9bea-d48f5922af00 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:51.897856 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-adb5b683-bad9-4f18-9bea-d48f5922af00 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:52.333710 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-adb5b683-bad9-4f18-9bea-d48f5922af00 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:52.351946 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-adb5b683-bad9-4f18-9bea-d48f5922af00 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1566 microversion: 2.1 time: 0.480028 Apr 20 18:34:52.352814 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 237/474] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:51 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1566 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:52.359753 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-f569c2f0-97c4-45a2-992e-11779d424f1e req-c12f4071-5855-453c-ba13-52f2ae87a827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c3b12a-8dae-44c3-b48e-4ec18cd0e235", "tag": "9a853972-a5f7-485a-a061-21bb26950d18"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:52.362542 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:34:52.362542 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:34:52.375297 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-f569c2f0-97c4-45a2-992e-11779d424f1e req-c12f4071-5855-453c-ba13-52f2ae87a827 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:52.376471 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-f569c2f0-97c4-45a2-992e-11779d424f1e req-c12f4071-5855-453c-ba13-52f2ae87a827 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:52.399691 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-f569c2f0-97c4-45a2-992e-11779d424f1e req-c12f4071-5855-453c-ba13-52f2ae87a827 service nova] Creating event network-changed:9a853972-a5f7-485a-a061-21bb26950d18 for instance 28c3b12a-8dae-44c3-b48e-4ec18cd0e235 on hv-cinder-78693 Apr 20 18:34:52.423602 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-f569c2f0-97c4-45a2-992e-11779d424f1e req-c12f4071-5855-453c-ba13-52f2ae87a827 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068773 Apr 20 18:34:52.424759 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 238/475] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:34:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:34:52.434998 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-775a639e-c76e-4a54-a5bb-4944909f1aa1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:52.435964 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-775a639e-c76e-4a54-a5bb-4944909f1aa1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:52.445935 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-775a639e-c76e-4a54-a5bb-4944909f1aa1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:52.446938 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-775a639e-c76e-4a54-a5bb-4944909f1aa1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:52.448024 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-775a639e-c76e-4a54-a5bb-4944909f1aa1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:52.448710 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-775a639e-c76e-4a54-a5bb-4944909f1aa1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:52.502397 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c0b8d5ec-e636-49d9-8cc4-34a163c04feb tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:52.514908 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c0b8d5ec-e636-49d9-8cc4-34a163c04feb tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235" status: 200 len: 1313 microversion: 2.1 time: 0.810975 Apr 20 18:34:52.516360 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 238/476] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:51 2021] GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235 => generated 1313 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:52.890828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ad8138f5-f6d1-4632-8d77-142f297a670d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:52.891735 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ad8138f5-f6d1-4632-8d77-142f297a670d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:52.909222 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ad8138f5-f6d1-4632-8d77-142f297a670d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:52.909777 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ad8138f5-f6d1-4632-8d77-142f297a670d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:52.910638 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ad8138f5-f6d1-4632-8d77-142f297a670d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:52.911140 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ad8138f5-f6d1-4632-8d77-142f297a670d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:53.341132 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-775a639e-c76e-4a54-a5bb-4944909f1aa1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:53.352111 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-775a639e-c76e-4a54-a5bb-4944909f1aa1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.925606 Apr 20 18:34:53.363221 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 239/477] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:52 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:53.369542 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4b7c6140-408c-4fde-9187-e896423e8ad5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:53.370385 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4b7c6140-408c-4fde-9187-e896423e8ad5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:53.399341 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4b7c6140-408c-4fde-9187-e896423e8ad5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:53.400177 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4b7c6140-408c-4fde-9187-e896423e8ad5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:53.401256 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4b7c6140-408c-4fde-9187-e896423e8ad5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:53.401956 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4b7c6140-408c-4fde-9187-e896423e8ad5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:53.436271 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ad8138f5-f6d1-4632-8d77-142f297a670d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:53.455871 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ad8138f5-f6d1-4632-8d77-142f297a670d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:53.468284 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ad8138f5-f6d1-4632-8d77-142f297a670d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:53.469768 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ad8138f5-f6d1-4632-8d77-142f297a670d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1738 microversion: 2.20 time: 0.584610 Apr 20 18:34:53.470415 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 239/478] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:52 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1738 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:34:53.497136 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-791308ee-463f-4cae-bce2-434576cb0a99 req-5cdc8b1d-b16d-4c9c-b84e-206dcb9fe57d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e532f85-bed6-43d3-969d-3a2688b4638b", "name": "network-vif-plugged", "status": "completed", "tag": "36707b77-0efd-41e0-9dc6-6332c175126e"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:53.501038 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:34:53.501038 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:34:53.515643 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-791308ee-463f-4cae-bce2-434576cb0a99 req-5cdc8b1d-b16d-4c9c-b84e-206dcb9fe57d service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:53.516370 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-791308ee-463f-4cae-bce2-434576cb0a99 req-5cdc8b1d-b16d-4c9c-b84e-206dcb9fe57d service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:53.539622 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-791308ee-463f-4cae-bce2-434576cb0a99 req-5cdc8b1d-b16d-4c9c-b84e-206dcb9fe57d service nova] Creating event network-vif-plugged:36707b77-0efd-41e0-9dc6-6332c175126e for instance 1e532f85-bed6-43d3-969d-3a2688b4638b on hv-cinder-78693 Apr 20 18:34:53.545274 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-791308ee-463f-4cae-bce2-434576cb0a99 req-5cdc8b1d-b16d-4c9c-b84e-206dcb9fe57d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057976 Apr 20 18:34:53.546469 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 240/479] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:34:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:34:53.557995 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-22165970-2ade-497c-9c4b-9c544ad83ebe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:53.558850 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-22165970-2ade-497c-9c4b-9c544ad83ebe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:53.577199 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-22165970-2ade-497c-9c4b-9c544ad83ebe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:53.577923 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-22165970-2ade-497c-9c4b-9c544ad83ebe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:53.579385 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-22165970-2ade-497c-9c4b-9c544ad83ebe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:53.580473 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-22165970-2ade-497c-9c4b-9c544ad83ebe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:53.636384 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-4b7c6140-408c-4fde-9187-e896423e8ad5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lazy-loading 'services' on Instance uuid ec63aa76-1efa-45ed-8e4d-89794690776f {{(pid=100593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:34:53.891496 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4b7c6140-408c-4fde-9187-e896423e8ad5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f/os-volume_attachments/46ba67ad-2698-4789-acd2-7dded5f4e3e0" status: 202 len: 0 microversion: 2.1 time: 0.526443 Apr 20 18:34:53.901150 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 240/480] 10.222.0.25 () {58 vars in 1406 bytes} [Tue Apr 20 18:34:53 2021] DELETE /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f/os-volume_attachments/46ba67ad-2698-4789-acd2-7dded5f4e3e0 => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:34:53.915827 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9ea13a0e-da34-48ba-ab1f-4ea9f02fa2c3 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:53.916633 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9ea13a0e-da34-48ba-ab1f-4ea9f02fa2c3 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:53.941272 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9ea13a0e-da34-48ba-ab1f-4ea9f02fa2c3 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:53.942550 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9ea13a0e-da34-48ba-ab1f-4ea9f02fa2c3 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:53.944089 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9ea13a0e-da34-48ba-ab1f-4ea9f02fa2c3 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:53.944600 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9ea13a0e-da34-48ba-ab1f-4ea9f02fa2c3 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:54.199333 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-22165970-2ade-497c-9c4b-9c544ad83ebe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:54.212348 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-22165970-2ade-497c-9c4b-9c544ad83ebe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1566 microversion: 2.1 time: 0.661331 Apr 20 18:34:54.223783 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 241/481] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:53 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1566 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:54.377481 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-de444ad5-4c29-4848-914e-e23634483cbb tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:54.378558 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-de444ad5-4c29-4848-914e-e23634483cbb tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:54.398298 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-de444ad5-4c29-4848-914e-e23634483cbb tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:54.398974 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-de444ad5-4c29-4848-914e-e23634483cbb tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:54.400122 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-de444ad5-4c29-4848-914e-e23634483cbb tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:54.401468 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-de444ad5-4c29-4848-914e-e23634483cbb tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:54.714321 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-de444ad5-4c29-4848-914e-e23634483cbb tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:54.724778 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-de444ad5-4c29-4848-914e-e23634483cbb tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.357696 Apr 20 18:34:54.727338 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 242/482] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:54 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:54.732942 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2a4fde32-6eb5-4c0c-ab96-cb9ed478d968 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:54.733906 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2a4fde32-6eb5-4c0c-ab96-cb9ed478d968 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:54.744547 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2a4fde32-6eb5-4c0c-ab96-cb9ed478d968 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:54.745057 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2a4fde32-6eb5-4c0c-ab96-cb9ed478d968 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:54.746237 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2a4fde32-6eb5-4c0c-ab96-cb9ed478d968 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:54.746747 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2a4fde32-6eb5-4c0c-ab96-cb9ed478d968 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:54.801899 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9ea13a0e-da34-48ba-ab1f-4ea9f02fa2c3 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:54.824148 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9ea13a0e-da34-48ba-ab1f-4ea9f02fa2c3 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235" status: 200 len: 1313 microversion: 2.1 time: 0.920819 Apr 20 18:34:54.833475 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 241/483] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:53 2021] GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235 => generated 1313 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:55.061357 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2a4fde32-6eb5-4c0c-ab96-cb9ed478d968 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:55.078296 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2a4fde32-6eb5-4c0c-ab96-cb9ed478d968 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:55.079954 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2a4fde32-6eb5-4c0c-ab96-cb9ed478d968 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:55.081260 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2a4fde32-6eb5-4c0c-ab96-cb9ed478d968 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1738 microversion: 2.20 time: 0.352847 Apr 20 18:34:55.094790 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 243/484] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:54 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1738 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:55.235179 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-89dd0190-6121-42a4-90c0-fdde4f41763a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:55.236236 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-89dd0190-6121-42a4-90c0-fdde4f41763a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:55.261338 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-89dd0190-6121-42a4-90c0-fdde4f41763a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:55.262117 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-89dd0190-6121-42a4-90c0-fdde4f41763a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:55.263750 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-89dd0190-6121-42a4-90c0-fdde4f41763a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:55.264657 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-89dd0190-6121-42a4-90c0-fdde4f41763a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:55.667430 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-89dd0190-6121-42a4-90c0-fdde4f41763a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:55.678739 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-89dd0190-6121-42a4-90c0-fdde4f41763a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1566 microversion: 2.1 time: 0.449035 Apr 20 18:34:55.681333 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 242/485] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:55 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1566 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:55.747248 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2e171ae2-a5a8-4e08-8b7b-bbd5a4fbd63e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:55.747941 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2e171ae2-a5a8-4e08-8b7b-bbd5a4fbd63e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:55.762192 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2e171ae2-a5a8-4e08-8b7b-bbd5a4fbd63e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:55.763175 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2e171ae2-a5a8-4e08-8b7b-bbd5a4fbd63e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:55.764738 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2e171ae2-a5a8-4e08-8b7b-bbd5a4fbd63e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:55.765770 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2e171ae2-a5a8-4e08-8b7b-bbd5a4fbd63e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:55.863289 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-55a73c1f-b92f-4d07-81fc-01f00ff84aa4 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:55.867945 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-55a73c1f-b92f-4d07-81fc-01f00ff84aa4 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:55.917433 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-55a73c1f-b92f-4d07-81fc-01f00ff84aa4 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:55.918750 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-55a73c1f-b92f-4d07-81fc-01f00ff84aa4 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:55.920747 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-55a73c1f-b92f-4d07-81fc-01f00ff84aa4 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:55.922068 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-55a73c1f-b92f-4d07-81fc-01f00ff84aa4 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:56.228669 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2e171ae2-a5a8-4e08-8b7b-bbd5a4fbd63e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:56.239684 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2e171ae2-a5a8-4e08-8b7b-bbd5a4fbd63e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.498457 Apr 20 18:34:56.241223 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 244/486] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:55 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:56.246305 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d389cb17-af0e-4d0d-8cfd-b77756b8b03b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:56.246983 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d389cb17-af0e-4d0d-8cfd-b77756b8b03b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:56.259737 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d389cb17-af0e-4d0d-8cfd-b77756b8b03b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:56.259884 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d389cb17-af0e-4d0d-8cfd-b77756b8b03b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:56.260660 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d389cb17-af0e-4d0d-8cfd-b77756b8b03b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:56.261276 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d389cb17-af0e-4d0d-8cfd-b77756b8b03b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:56.558732 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-55a73c1f-b92f-4d07-81fc-01f00ff84aa4 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:56.571453 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-55a73c1f-b92f-4d07-81fc-01f00ff84aa4 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235" status: 200 len: 1313 microversion: 2.1 time: 0.730941 Apr 20 18:34:56.582880 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 243/487] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:55 2021] GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235 => generated 1313 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:56.711447 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-80e01bb5-46dc-4ec1-98be-758c60228dce tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:56.711447 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-80e01bb5-46dc-4ec1-98be-758c60228dce tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:56.728869 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-80e01bb5-46dc-4ec1-98be-758c60228dce tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:56.729706 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-80e01bb5-46dc-4ec1-98be-758c60228dce tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:56.730935 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-80e01bb5-46dc-4ec1-98be-758c60228dce tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:56.732998 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-80e01bb5-46dc-4ec1-98be-758c60228dce tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:56.846979 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d389cb17-af0e-4d0d-8cfd-b77756b8b03b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:56.873014 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d389cb17-af0e-4d0d-8cfd-b77756b8b03b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:56.875153 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d389cb17-af0e-4d0d-8cfd-b77756b8b03b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:56.876449 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d389cb17-af0e-4d0d-8cfd-b77756b8b03b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1738 microversion: 2.20 time: 0.634030 Apr 20 18:34:56.877054 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 245/488] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:56 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1738 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:57.237904 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-80e01bb5-46dc-4ec1-98be-758c60228dce tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:57.261446 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-80e01bb5-46dc-4ec1-98be-758c60228dce tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1566 microversion: 2.1 time: 0.555399 Apr 20 18:34:57.261815 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d7f6c444-394c-4231-9ab1-25780913450f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:57.262706 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 244/489] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:56 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1566 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:34:57.262899 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d7f6c444-394c-4231-9ab1-25780913450f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:57.272913 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d7f6c444-394c-4231-9ab1-25780913450f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:57.273421 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d7f6c444-394c-4231-9ab1-25780913450f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:57.291493 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d7f6c444-394c-4231-9ab1-25780913450f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:57.292417 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d7f6c444-394c-4231-9ab1-25780913450f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:57.594817 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e62c8255-8f0f-4738-b58c-9f69e5aaedc4 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:57.595505 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e62c8255-8f0f-4738-b58c-9f69e5aaedc4 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:57.611009 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e62c8255-8f0f-4738-b58c-9f69e5aaedc4 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:57.614123 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e62c8255-8f0f-4738-b58c-9f69e5aaedc4 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:57.615865 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e62c8255-8f0f-4738-b58c-9f69e5aaedc4 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:57.618599 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e62c8255-8f0f-4738-b58c-9f69e5aaedc4 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:57.739877 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d7f6c444-394c-4231-9ab1-25780913450f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:57.755188 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d7f6c444-394c-4231-9ab1-25780913450f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1723 microversion: 2.1 time: 0.500414 Apr 20 18:34:57.766213 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 246/490] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:57 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1723 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:57.898959 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2e54ce95-6f35-4ffc-ba7c-4b1172b6c862 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:57.899929 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2e54ce95-6f35-4ffc-ba7c-4b1172b6c862 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:57.931441 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2e54ce95-6f35-4ffc-ba7c-4b1172b6c862 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:57.932547 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2e54ce95-6f35-4ffc-ba7c-4b1172b6c862 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:57.934358 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2e54ce95-6f35-4ffc-ba7c-4b1172b6c862 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:57.935696 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2e54ce95-6f35-4ffc-ba7c-4b1172b6c862 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:57.956756 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e62c8255-8f0f-4738-b58c-9f69e5aaedc4 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:57.967602 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e62c8255-8f0f-4738-b58c-9f69e5aaedc4 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235" status: 200 len: 1313 microversion: 2.1 time: 0.376801 Apr 20 18:34:57.968385 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 245/491] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:57 2021] GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:34:58.299516 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3b1e4beb-9b0b-484f-90bf-65e23ca2e0c0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:58.313951 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3b1e4beb-9b0b-484f-90bf-65e23ca2e0c0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:58.346562 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3b1e4beb-9b0b-484f-90bf-65e23ca2e0c0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:58.347086 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3b1e4beb-9b0b-484f-90bf-65e23ca2e0c0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:58.348804 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3b1e4beb-9b0b-484f-90bf-65e23ca2e0c0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:58.354080 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3b1e4beb-9b0b-484f-90bf-65e23ca2e0c0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:58.459709 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2e54ce95-6f35-4ffc-ba7c-4b1172b6c862 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:58.517669 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2e54ce95-6f35-4ffc-ba7c-4b1172b6c862 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:58.525646 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2e54ce95-6f35-4ffc-ba7c-4b1172b6c862 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:58.527303 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2e54ce95-6f35-4ffc-ba7c-4b1172b6c862 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1738 microversion: 2.20 time: 0.633861 Apr 20 18:34:58.528165 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 247/492] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:57 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1738 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:34:58.729727 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3b1e4beb-9b0b-484f-90bf-65e23ca2e0c0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:58.743110 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3b1e4beb-9b0b-484f-90bf-65e23ca2e0c0 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1566 microversion: 2.1 time: 0.459475 Apr 20 18:34:58.744644 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 246/493] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:58 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1566 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:58.790471 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5ea1b7db-f96e-4a71-9a96-2c2599a0e6ed tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:58.792094 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5ea1b7db-f96e-4a71-9a96-2c2599a0e6ed tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:58.808847 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5ea1b7db-f96e-4a71-9a96-2c2599a0e6ed tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:58.810162 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5ea1b7db-f96e-4a71-9a96-2c2599a0e6ed tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:58.811960 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5ea1b7db-f96e-4a71-9a96-2c2599a0e6ed tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:58.813093 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5ea1b7db-f96e-4a71-9a96-2c2599a0e6ed tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:58.998619 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-cdbd7fc7-f342-4e2c-8113-80be405757ff tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:59.007545 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-cdbd7fc7-f342-4e2c-8113-80be405757ff tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:59.022682 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cdbd7fc7-f342-4e2c-8113-80be405757ff tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:59.023202 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cdbd7fc7-f342-4e2c-8113-80be405757ff tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:59.024276 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cdbd7fc7-f342-4e2c-8113-80be405757ff tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:59.024833 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cdbd7fc7-f342-4e2c-8113-80be405757ff tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:59.267936 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5ea1b7db-f96e-4a71-9a96-2c2599a0e6ed tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:59.301889 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5ea1b7db-f96e-4a71-9a96-2c2599a0e6ed tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1700 microversion: 2.1 time: 0.526428 Apr 20 18:34:59.302789 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 248/494] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:58 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1700 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:59.325575 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f5d3513e-f752-4336-be54-08b199418e67 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:34:59.339443 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f5d3513e-f752-4336-be54-08b199418e67 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:59.340324 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f5d3513e-f752-4336-be54-08b199418e67 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:59.435586 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f5d3513e-f752-4336-be54-08b199418e67 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Going to try to start instance {{(pid=100592) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 20 18:34:59.589529 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-cdbd7fc7-f342-4e2c-8113-80be405757ff tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:34:59.603147 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f5d3513e-f752-4336-be54-08b199418e67 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 202 len: 0 microversion: 2.1 time: 0.281557 Apr 20 18:34:59.604160 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 249/495] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:34:59 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:34:59.612172 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5b3eb4ac-f6bb-4569-907e-4e821cb6ac89 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:59.613423 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5b3eb4ac-f6bb-4569-907e-4e821cb6ac89 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:59.625711 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5b3eb4ac-f6bb-4569-907e-4e821cb6ac89 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:59.626784 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5b3eb4ac-f6bb-4569-907e-4e821cb6ac89 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:59.627714 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5b3eb4ac-f6bb-4569-907e-4e821cb6ac89 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:59.628270 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5b3eb4ac-f6bb-4569-907e-4e821cb6ac89 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:59.673356 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-cdbd7fc7-f342-4e2c-8113-80be405757ff tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235" status: 200 len: 1313 microversion: 2.1 time: 0.685714 Apr 20 18:34:59.675852 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 247/496] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:34:58 2021] GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235 => generated 1313 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:34:59.694371 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-788aa5da-d0a8-4e21-ac08-e155afa34378 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:34:59.695629 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-788aa5da-d0a8-4e21-ac08-e155afa34378 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:34:59.713989 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-788aa5da-d0a8-4e21-ac08-e155afa34378 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:59.715291 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-788aa5da-d0a8-4e21-ac08-e155afa34378 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:34:59.717773 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-788aa5da-d0a8-4e21-ac08-e155afa34378 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:34:59.718853 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-788aa5da-d0a8-4e21-ac08-e155afa34378 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:00.026916 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5b3eb4ac-f6bb-4569-907e-4e821cb6ac89 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:00.043331 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5b3eb4ac-f6bb-4569-907e-4e821cb6ac89 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:00.049741 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5b3eb4ac-f6bb-4569-907e-4e821cb6ac89 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:00.051098 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5b3eb4ac-f6bb-4569-907e-4e821cb6ac89 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1738 microversion: 2.20 time: 0.444652 Apr 20 18:35:00.051738 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 250/497] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:34:59 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1738 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:00.077241 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ba80858a-d0e5-40cf-b02b-c4d31a2c0e62 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:00.078342 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ba80858a-d0e5-40cf-b02b-c4d31a2c0e62 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:00.090035 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ba80858a-d0e5-40cf-b02b-c4d31a2c0e62 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:00.090892 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ba80858a-d0e5-40cf-b02b-c4d31a2c0e62 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:00.091972 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ba80858a-d0e5-40cf-b02b-c4d31a2c0e62 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:00.093108 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ba80858a-d0e5-40cf-b02b-c4d31a2c0e62 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:00.511329 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ba80858a-d0e5-40cf-b02b-c4d31a2c0e62 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:00.535044 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ba80858a-d0e5-40cf-b02b-c4d31a2c0e62 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1709 microversion: 2.1 time: 0.464252 Apr 20 18:35:00.548057 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 251/498] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:00 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1709 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:00.558640 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-777b0e06-3d7f-480b-96ad-eae3558dae54 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:00.559447 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-777b0e06-3d7f-480b-96ad-eae3558dae54 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:00.580474 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-777b0e06-3d7f-480b-96ad-eae3558dae54 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:00.580997 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-777b0e06-3d7f-480b-96ad-eae3558dae54 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:00.586194 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-777b0e06-3d7f-480b-96ad-eae3558dae54 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:00.586732 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-777b0e06-3d7f-480b-96ad-eae3558dae54 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:00.681762 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-788aa5da-d0a8-4e21-ac08-e155afa34378 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lazy-loading 'services' on Instance uuid 6cc910f0-1c12-4462-acd1-89bb382a4005 {{(pid=100593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:35:01.198462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-777b0e06-3d7f-480b-96ad-eae3558dae54 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:01.210399 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-777b0e06-3d7f-480b-96ad-eae3558dae54 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1566 microversion: 2.1 time: 0.660904 Apr 20 18:35:01.211737 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 252/499] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:00 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1566 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:01.230565 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-39921f8e-f1c9-4e1f-a14f-58e31d4b2adf tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:01.231436 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-39921f8e-f1c9-4e1f-a14f-58e31d4b2adf tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:01.247823 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-39921f8e-f1c9-4e1f-a14f-58e31d4b2adf tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:01.248400 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-39921f8e-f1c9-4e1f-a14f-58e31d4b2adf tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:01.254714 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-39921f8e-f1c9-4e1f-a14f-58e31d4b2adf tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:01.255539 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-39921f8e-f1c9-4e1f-a14f-58e31d4b2adf tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:01.319194 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-788aa5da-d0a8-4e21-ac08-e155afa34378 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005/os-volume_attachments/f5246272-a712-46f2-b999-0688ac257186" status: 202 len: 0 microversion: 2.1 time: 1.640411 Apr 20 18:35:01.322423 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 248/500] 10.222.0.25 () {58 vars in 1406 bytes} [Tue Apr 20 18:34:59 2021] DELETE /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005/os-volume_attachments/f5246272-a712-46f2-b999-0688ac257186 => generated 0 bytes in 1646 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:35:01.340019 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-07bfff1a-0d09-473f-a76b-eb2e722daec2 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:01.348379 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-07bfff1a-0d09-473f-a76b-eb2e722daec2 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:01.377914 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-07bfff1a-0d09-473f-a76b-eb2e722daec2 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:01.383119 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-07bfff1a-0d09-473f-a76b-eb2e722daec2 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:01.384371 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-07bfff1a-0d09-473f-a76b-eb2e722daec2 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:01.385080 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-07bfff1a-0d09-473f-a76b-eb2e722daec2 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:01.600948 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-07bfff1a-0d09-473f-a76b-eb2e722daec2 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Going to try to terminate instance {{(pid=100593) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:35:01.821186 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-07bfff1a-0d09-473f-a76b-eb2e722daec2 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f" status: 204 len: 0 microversion: 2.1 time: 0.496707 Apr 20 18:35:01.822124 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 249/501] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:35:01 2021] DELETE /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:35:01.840541 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-57b6935f-0431-4bf4-8553-5a94192b3be2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:01.841634 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-57b6935f-0431-4bf4-8553-5a94192b3be2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:01.855910 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-39921f8e-f1c9-4e1f-a14f-58e31d4b2adf tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:01.856920 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-57b6935f-0431-4bf4-8553-5a94192b3be2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:01.857705 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-57b6935f-0431-4bf4-8553-5a94192b3be2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:01.859569 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-57b6935f-0431-4bf4-8553-5a94192b3be2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:01.860262 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-57b6935f-0431-4bf4-8553-5a94192b3be2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:01.882717 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-39921f8e-f1c9-4e1f-a14f-58e31d4b2adf tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235" status: 200 len: 1313 microversion: 2.1 time: 0.660328 Apr 20 18:35:01.883831 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 253/502] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:01 2021] GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235 => generated 1313 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:01.910110 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-919473f8-b009-4189-bc6b-c99511be34c5 req-e46b015e-7269-4d2c-a29c-6082732beb1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c3b12a-8dae-44c3-b48e-4ec18cd0e235", "name": "network-vif-plugged", "status": "completed", "tag": "9a853972-a5f7-485a-a061-21bb26950d18"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:35:01.912237 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:35:01.912237 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:35:01.935536 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-919473f8-b009-4189-bc6b-c99511be34c5 req-e46b015e-7269-4d2c-a29c-6082732beb1d service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:01.936062 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-919473f8-b009-4189-bc6b-c99511be34c5 req-e46b015e-7269-4d2c-a29c-6082732beb1d service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:01.974020 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-919473f8-b009-4189-bc6b-c99511be34c5 req-e46b015e-7269-4d2c-a29c-6082732beb1d service nova] Creating event network-vif-plugged:9a853972-a5f7-485a-a061-21bb26950d18 for instance 28c3b12a-8dae-44c3-b48e-4ec18cd0e235 on hv-cinder-78693 Apr 20 18:35:01.992870 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-919473f8-b009-4189-bc6b-c99511be34c5 req-e46b015e-7269-4d2c-a29c-6082732beb1d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098697 Apr 20 18:35:01.995413 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 254/503] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:35:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:35:02.008216 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-623aab99-b7db-4a9c-9b30-ababe3742057 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:02.009427 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-623aab99-b7db-4a9c-9b30-ababe3742057 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:02.027721 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-623aab99-b7db-4a9c-9b30-ababe3742057 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:02.028676 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-623aab99-b7db-4a9c-9b30-ababe3742057 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:02.030409 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-623aab99-b7db-4a9c-9b30-ababe3742057 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:02.031379 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-623aab99-b7db-4a9c-9b30-ababe3742057 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:02.327568 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-57b6935f-0431-4bf4-8553-5a94192b3be2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:02.343377 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-57b6935f-0431-4bf4-8553-5a94192b3be2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:02.346029 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-57b6935f-0431-4bf4-8553-5a94192b3be2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:02.347631 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-57b6935f-0431-4bf4-8553-5a94192b3be2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1738 microversion: 2.20 time: 0.521245 Apr 20 18:35:02.348506 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 250/504] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:01 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1738 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:02.354813 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-248898a3-2cb1-4e19-9eed-ace8025e1d40 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:02.356104 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-248898a3-2cb1-4e19-9eed-ace8025e1d40 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:02.376501 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-623aab99-b7db-4a9c-9b30-ababe3742057 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:02.389920 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-623aab99-b7db-4a9c-9b30-ababe3742057 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1709 microversion: 2.1 time: 0.392365 Apr 20 18:35:02.390850 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 255/505] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:01 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1709 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:02.394025 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-248898a3-2cb1-4e19-9eed-ace8025e1d40 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:02.394548 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-248898a3-2cb1-4e19-9eed-ace8025e1d40 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:02.395429 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-248898a3-2cb1-4e19-9eed-ace8025e1d40 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:02.395929 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-248898a3-2cb1-4e19-9eed-ace8025e1d40 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:02.397535 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-18b96abf-f067-4fe4-ba38-99053f351046 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:02.398744 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-18b96abf-f067-4fe4-ba38-99053f351046 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:02.407614 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-18b96abf-f067-4fe4-ba38-99053f351046 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:02.408772 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-18b96abf-f067-4fe4-ba38-99053f351046 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:02.409880 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-18b96abf-f067-4fe4-ba38-99053f351046 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:02.411110 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-18b96abf-f067-4fe4-ba38-99053f351046 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:02.781785 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-18b96abf-f067-4fe4-ba38-99053f351046 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:02.806635 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-18b96abf-f067-4fe4-ba38-99053f351046 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1566 microversion: 2.1 time: 0.413732 Apr 20 18:35:02.808686 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 256/506] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:02 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1566 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:02.900828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-eba9ab7f-4aec-4394-947b-9d89210353fc tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:02.901597 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-eba9ab7f-4aec-4394-947b-9d89210353fc tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:02.922813 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eba9ab7f-4aec-4394-947b-9d89210353fc tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:02.923346 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eba9ab7f-4aec-4394-947b-9d89210353fc tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:02.924304 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eba9ab7f-4aec-4394-947b-9d89210353fc tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:02.924729 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eba9ab7f-4aec-4394-947b-9d89210353fc tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:03.018595 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-248898a3-2cb1-4e19-9eed-ace8025e1d40 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:03.033074 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-248898a3-2cb1-4e19-9eed-ace8025e1d40 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f" status: 200 len: 1513 microversion: 2.1 time: 0.683084 Apr 20 18:35:03.038376 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 251/507] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:02 2021] GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f => generated 1513 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:03.225119 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-eba9ab7f-4aec-4394-947b-9d89210353fc tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:03.239149 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-eba9ab7f-4aec-4394-947b-9d89210353fc tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235" status: 200 len: 1313 microversion: 2.1 time: 0.342645 Apr 20 18:35:03.251437 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 257/508] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:02 2021] GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235 => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:03.379156 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3a7818d0-b5c6-4b68-a705-9ca8ea26c28c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:03.380645 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3a7818d0-b5c6-4b68-a705-9ca8ea26c28c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:03.402529 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3a7818d0-b5c6-4b68-a705-9ca8ea26c28c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:03.403048 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3a7818d0-b5c6-4b68-a705-9ca8ea26c28c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:03.404181 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3a7818d0-b5c6-4b68-a705-9ca8ea26c28c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:03.404876 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3a7818d0-b5c6-4b68-a705-9ca8ea26c28c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:03.421298 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-282ac605-1de3-4873-81d9-814a9ba43314 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:03.422250 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-282ac605-1de3-4873-81d9-814a9ba43314 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:03.437066 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-282ac605-1de3-4873-81d9-814a9ba43314 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:03.441216 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-282ac605-1de3-4873-81d9-814a9ba43314 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:03.442504 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-282ac605-1de3-4873-81d9-814a9ba43314 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:03.445243 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-282ac605-1de3-4873-81d9-814a9ba43314 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:03.798078 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3a7818d0-b5c6-4b68-a705-9ca8ea26c28c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:03.851869 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3a7818d0-b5c6-4b68-a705-9ca8ea26c28c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:03.857797 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3a7818d0-b5c6-4b68-a705-9ca8ea26c28c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:03.860749 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3a7818d0-b5c6-4b68-a705-9ca8ea26c28c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1738 microversion: 2.20 time: 0.495565 Apr 20 18:35:03.862267 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 252/509] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:03 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1738 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:35:03.893226 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7e4b0881-fbb3-466c-a170-cdc82cc77562 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:03.899843 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7e4b0881-fbb3-466c-a170-cdc82cc77562 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:03.923999 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7e4b0881-fbb3-466c-a170-cdc82cc77562 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:03.925506 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7e4b0881-fbb3-466c-a170-cdc82cc77562 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:03.928144 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7e4b0881-fbb3-466c-a170-cdc82cc77562 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:03.929577 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7e4b0881-fbb3-466c-a170-cdc82cc77562 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:04.104748 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-282ac605-1de3-4873-81d9-814a9ba43314 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:04.146274 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-282ac605-1de3-4873-81d9-814a9ba43314 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1709 microversion: 2.1 time: 0.728842 Apr 20 18:35:04.155091 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 258/510] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:03 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1709 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:04.168406 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e05cb38c-ba65-4fac-8a9e-006304c79b57 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:04.170482 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e05cb38c-ba65-4fac-8a9e-006304c79b57 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:04.190180 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e05cb38c-ba65-4fac-8a9e-006304c79b57 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:04.191708 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e05cb38c-ba65-4fac-8a9e-006304c79b57 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:04.195746 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e05cb38c-ba65-4fac-8a9e-006304c79b57 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:04.198091 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e05cb38c-ba65-4fac-8a9e-006304c79b57 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:04.492827 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7e4b0881-fbb3-466c-a170-cdc82cc77562 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:04.503399 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7e4b0881-fbb3-466c-a170-cdc82cc77562 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1566 microversion: 2.1 time: 0.639167 Apr 20 18:35:04.504341 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 253/511] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:03 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1566 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:04.520677 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-076b415d-c1d7-40e3-82d7-b27813a0181c tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:04.522372 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-076b415d-c1d7-40e3-82d7-b27813a0181c tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:04.531677 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-076b415d-c1d7-40e3-82d7-b27813a0181c tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:04.532391 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-076b415d-c1d7-40e3-82d7-b27813a0181c tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:04.533270 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-076b415d-c1d7-40e3-82d7-b27813a0181c tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:04.533807 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-076b415d-c1d7-40e3-82d7-b27813a0181c tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:04.781055 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e05cb38c-ba65-4fac-8a9e-006304c79b57 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:04.793297 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e05cb38c-ba65-4fac-8a9e-006304c79b57 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f" status: 200 len: 1513 microversion: 2.1 time: 0.634429 Apr 20 18:35:04.794461 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 259/512] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:04 2021] GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f => generated 1513 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:04.883142 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-96d20fb5-a38c-4e3c-bb82-4a91f4326a83 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:04.883832 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-96d20fb5-a38c-4e3c-bb82-4a91f4326a83 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:04.891215 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-076b415d-c1d7-40e3-82d7-b27813a0181c tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:04.893899 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-96d20fb5-a38c-4e3c-bb82-4a91f4326a83 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:04.894419 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-96d20fb5-a38c-4e3c-bb82-4a91f4326a83 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:04.895296 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-96d20fb5-a38c-4e3c-bb82-4a91f4326a83 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:04.895825 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-96d20fb5-a38c-4e3c-bb82-4a91f4326a83 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:04.900650 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-076b415d-c1d7-40e3-82d7-b27813a0181c tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235" status: 200 len: 1313 microversion: 2.1 time: 0.385298 Apr 20 18:35:04.901312 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 254/513] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:04 2021] GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235 => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:05.181966 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ce4a03eb-9a17-4194-835a-907d6e384517 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:05.183085 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ce4a03eb-9a17-4194-835a-907d6e384517 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:05.197772 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ce4a03eb-9a17-4194-835a-907d6e384517 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:05.201464 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ce4a03eb-9a17-4194-835a-907d6e384517 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:05.203125 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ce4a03eb-9a17-4194-835a-907d6e384517 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:05.204154 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ce4a03eb-9a17-4194-835a-907d6e384517 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:05.245103 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-96d20fb5-a38c-4e3c-bb82-4a91f4326a83 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:05.257256 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-96d20fb5-a38c-4e3c-bb82-4a91f4326a83 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:05.261223 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-96d20fb5-a38c-4e3c-bb82-4a91f4326a83 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:05.264055 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-96d20fb5-a38c-4e3c-bb82-4a91f4326a83 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1738 microversion: 2.20 time: 0.385111 Apr 20 18:35:05.265735 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 260/514] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:04 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1738 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:05.533488 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0347b9fb-7915-4a51-b89b-eb6a6870f0f4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:05.534309 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0347b9fb-7915-4a51-b89b-eb6a6870f0f4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:05.552061 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0347b9fb-7915-4a51-b89b-eb6a6870f0f4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:05.554939 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0347b9fb-7915-4a51-b89b-eb6a6870f0f4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:05.557449 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0347b9fb-7915-4a51-b89b-eb6a6870f0f4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:05.559189 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0347b9fb-7915-4a51-b89b-eb6a6870f0f4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:05.798735 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ce4a03eb-9a17-4194-835a-907d6e384517 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:05.812100 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ce4a03eb-9a17-4194-835a-907d6e384517 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1713 microversion: 2.1 time: 0.635720 Apr 20 18:35:05.813488 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 255/515] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:05 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1713 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:35:05.819947 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-43820d6c-f679-4626-b147-7372561acf8d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:05.820927 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-43820d6c-f679-4626-b147-7372561acf8d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:05.830883 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-43820d6c-f679-4626-b147-7372561acf8d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:05.831734 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-43820d6c-f679-4626-b147-7372561acf8d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:05.832791 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-43820d6c-f679-4626-b147-7372561acf8d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:05.833599 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-43820d6c-f679-4626-b147-7372561acf8d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:06.126003 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0347b9fb-7915-4a51-b89b-eb6a6870f0f4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:06.140848 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0347b9fb-7915-4a51-b89b-eb6a6870f0f4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1566 microversion: 2.1 time: 0.620414 Apr 20 18:35:06.145456 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 261/516] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:05 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1566 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:06.151758 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1f433620-3836-4baf-bd25-f049ccc6f33d tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:06.152562 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1f433620-3836-4baf-bd25-f049ccc6f33d tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:06.161590 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1f433620-3836-4baf-bd25-f049ccc6f33d tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:06.163144 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-43820d6c-f679-4626-b147-7372561acf8d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:06.163428 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1f433620-3836-4baf-bd25-f049ccc6f33d tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:06.164430 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1f433620-3836-4baf-bd25-f049ccc6f33d tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:06.165021 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1f433620-3836-4baf-bd25-f049ccc6f33d tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:06.176824 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-43820d6c-f679-4626-b147-7372561acf8d tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f" status: 200 len: 1513 microversion: 2.1 time: 0.361665 Apr 20 18:35:06.179222 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 256/517] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:05 2021] GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f => generated 1513 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:06.190487 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-08cb80c1-cbdf-4d8a-b53f-d914bc529503 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:06.204042 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-08cb80c1-cbdf-4d8a-b53f-d914bc529503 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:06.223267 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-08cb80c1-cbdf-4d8a-b53f-d914bc529503 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:06.229384 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-08cb80c1-cbdf-4d8a-b53f-d914bc529503 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:06.230917 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-08cb80c1-cbdf-4d8a-b53f-d914bc529503 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:06.231521 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-08cb80c1-cbdf-4d8a-b53f-d914bc529503 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:06.325848 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-08cb80c1-cbdf-4d8a-b53f-d914bc529503 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Going to try to terminate instance {{(pid=100593) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:35:06.553749 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1f433620-3836-4baf-bd25-f049ccc6f33d tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:06.571983 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1f433620-3836-4baf-bd25-f049ccc6f33d tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235" status: 200 len: 1495 microversion: 2.1 time: 0.424147 Apr 20 18:35:06.572656 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 262/518] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:06 2021] GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235 => generated 1495 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:06.579121 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f40e7abd-1843-4415-b262-e2e82aa1b273 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:06.582206 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f40e7abd-1843-4415-b262-e2e82aa1b273 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:06.592179 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f40e7abd-1843-4415-b262-e2e82aa1b273 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:06.593043 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f40e7abd-1843-4415-b262-e2e82aa1b273 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:06.601126 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-08cb80c1-cbdf-4d8a-b53f-d914bc529503 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 204 len: 0 microversion: 2.1 time: 0.419141 Apr 20 18:35:06.607860 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 257/519] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:35:06 2021] DELETE /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:35:06.610967 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f40e7abd-1843-4415-b262-e2e82aa1b273 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:06.622690 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f40e7abd-1843-4415-b262-e2e82aa1b273 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:06.622823 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7428c0da-f423-4ad1-ad48-12374f17f80e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:06.624416 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7428c0da-f423-4ad1-ad48-12374f17f80e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:06.644523 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7428c0da-f423-4ad1-ad48-12374f17f80e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:06.645438 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7428c0da-f423-4ad1-ad48-12374f17f80e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:06.649319 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7428c0da-f423-4ad1-ad48-12374f17f80e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:06.650213 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7428c0da-f423-4ad1-ad48-12374f17f80e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:06.968878 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f40e7abd-1843-4415-b262-e2e82aa1b273 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:06.983810 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f40e7abd-1843-4415-b262-e2e82aa1b273 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:06.986451 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f40e7abd-1843-4415-b262-e2e82aa1b273 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:06.988144 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f40e7abd-1843-4415-b262-e2e82aa1b273 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1738 microversion: 2.20 time: 0.414438 Apr 20 18:35:06.989474 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 263/520] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:06 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1738 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:07.095835 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7428c0da-f423-4ad1-ad48-12374f17f80e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:07.112048 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7428c0da-f423-4ad1-ad48-12374f17f80e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1511 microversion: 2.1 time: 0.501463 Apr 20 18:35:07.113028 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 258/521] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:06 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1511 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:07.178676 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3e8316db-635d-4d74-9e8e-e54432442469 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:07.180009 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3e8316db-635d-4d74-9e8e-e54432442469 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:07.200160 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-00526b2f-3356-42bd-96cf-ec829bbed064 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:07.201148 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-00526b2f-3356-42bd-96cf-ec829bbed064 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:07.210769 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3e8316db-635d-4d74-9e8e-e54432442469 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:07.212293 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3e8316db-635d-4d74-9e8e-e54432442469 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:07.214768 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3e8316db-635d-4d74-9e8e-e54432442469 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:07.215921 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3e8316db-635d-4d74-9e8e-e54432442469 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:07.218136 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-00526b2f-3356-42bd-96cf-ec829bbed064 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:07.218653 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-00526b2f-3356-42bd-96cf-ec829bbed064 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:07.224894 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-00526b2f-3356-42bd-96cf-ec829bbed064 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:07.225442 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-00526b2f-3356-42bd-96cf-ec829bbed064 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:07.678486 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3e8316db-635d-4d74-9e8e-e54432442469 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:07.691178 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3e8316db-635d-4d74-9e8e-e54432442469 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1566 microversion: 2.1 time: 0.529423 Apr 20 18:35:07.713514 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 264/522] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:07 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1566 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:07.933368 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-00526b2f-3356-42bd-96cf-ec829bbed064 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:07.955778 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-00526b2f-3356-42bd-96cf-ec829bbed064 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f" status: 200 len: 1513 microversion: 2.1 time: 0.762861 Apr 20 18:35:07.956751 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 259/523] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:07 2021] GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f => generated 1513 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:08.021432 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1ca083aa-c185-41b8-9668-81670b693420 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:08.022936 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1ca083aa-c185-41b8-9668-81670b693420 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:08.039927 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1ca083aa-c185-41b8-9668-81670b693420 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:08.039927 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1ca083aa-c185-41b8-9668-81670b693420 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:08.042198 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1ca083aa-c185-41b8-9668-81670b693420 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:08.042331 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1ca083aa-c185-41b8-9668-81670b693420 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:08.133691 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-db20efdd-3f24-49f4-b4dc-43a12481bbb8 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:08.134741 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-db20efdd-3f24-49f4-b4dc-43a12481bbb8 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:08.150551 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-db20efdd-3f24-49f4-b4dc-43a12481bbb8 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:08.151463 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-db20efdd-3f24-49f4-b4dc-43a12481bbb8 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:08.155884 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-db20efdd-3f24-49f4-b4dc-43a12481bbb8 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:08.156642 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-db20efdd-3f24-49f4-b4dc-43a12481bbb8 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:08.499343 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1ca083aa-c185-41b8-9668-81670b693420 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:08.511154 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1ca083aa-c185-41b8-9668-81670b693420 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:08.513720 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1ca083aa-c185-41b8-9668-81670b693420 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:08.515061 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1ca083aa-c185-41b8-9668-81670b693420 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1738 microversion: 2.20 time: 0.498128 Apr 20 18:35:08.529208 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 265/524] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:08 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1738 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:08.535286 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e2e6de67-6fe7-4343-baf0-614e37e27d8c tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:08.535855 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e2e6de67-6fe7-4343-baf0-614e37e27d8c tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:08.549442 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e2e6de67-6fe7-4343-baf0-614e37e27d8c tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:08.550034 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e2e6de67-6fe7-4343-baf0-614e37e27d8c tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:08.550957 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e2e6de67-6fe7-4343-baf0-614e37e27d8c tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:08.552567 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e2e6de67-6fe7-4343-baf0-614e37e27d8c tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:08.644389 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e2e6de67-6fe7-4343-baf0-614e37e27d8c tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] Going to try to terminate instance {{(pid=100592) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:35:08.809771 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-db20efdd-3f24-49f4-b4dc-43a12481bbb8 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:08.823670 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-db20efdd-3f24-49f4-b4dc-43a12481bbb8 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1511 microversion: 2.1 time: 0.695128 Apr 20 18:35:08.838517 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 260/525] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:08 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1511 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:08.847313 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1a645b9e-c220-4f8e-86f3-1caab665cc47 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:08.847992 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1a645b9e-c220-4f8e-86f3-1caab665cc47 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:08.853242 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e2e6de67-6fe7-4343-baf0-614e37e27d8c tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "DELETE /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235" status: 204 len: 0 microversion: 2.1 time: 0.322445 Apr 20 18:35:08.853988 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 266/526] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:35:08 2021] DELETE /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:35:08.869221 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-bc5cab69-3c72-4c5f-a66c-209d208b0a3f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:08.870233 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-bc5cab69-3c72-4c5f-a66c-209d208b0a3f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:08.872171 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1a645b9e-c220-4f8e-86f3-1caab665cc47 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:08.872677 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1a645b9e-c220-4f8e-86f3-1caab665cc47 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:08.874532 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1a645b9e-c220-4f8e-86f3-1caab665cc47 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:08.874532 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1a645b9e-c220-4f8e-86f3-1caab665cc47 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:08.880304 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bc5cab69-3c72-4c5f-a66c-209d208b0a3f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:08.881227 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bc5cab69-3c72-4c5f-a66c-209d208b0a3f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:08.882534 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bc5cab69-3c72-4c5f-a66c-209d208b0a3f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:08.883127 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bc5cab69-3c72-4c5f-a66c-209d208b0a3f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:09.495685 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-bc5cab69-3c72-4c5f-a66c-209d208b0a3f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:09.534770 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-bc5cab69-3c72-4c5f-a66c-209d208b0a3f tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235" status: 200 len: 1501 microversion: 2.1 time: 0.672465 Apr 20 18:35:09.549558 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 267/527] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:08 2021] GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235 => generated 1501 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:09.560541 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b9cbb6d5-6e76-4185-b246-061f34eb55b8 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:09.561233 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b9cbb6d5-6e76-4185-b246-061f34eb55b8 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:09.591378 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b9cbb6d5-6e76-4185-b246-061f34eb55b8 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:09.591819 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b9cbb6d5-6e76-4185-b246-061f34eb55b8 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:09.597314 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b9cbb6d5-6e76-4185-b246-061f34eb55b8 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:09.597944 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b9cbb6d5-6e76-4185-b246-061f34eb55b8 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:09.609952 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1a645b9e-c220-4f8e-86f3-1caab665cc47 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:09.622481 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1a645b9e-c220-4f8e-86f3-1caab665cc47 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1566 microversion: 2.1 time: 0.782602 Apr 20 18:35:09.623147 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 261/528] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:08 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1566 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:09.628969 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-0bb75a5c-32be-499b-9a49-1fa4a70add80 req-3588cbd0-66c4-44a3-941c-ab4370352b02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec63aa76-1efa-45ed-8e4d-89794690776f", "name": "network-vif-deleted", "tag": "06a72144-d46d-42ad-aef8-3b655cd2b4c6"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:35:09.631770 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:35:09.631770 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:35:09.685866 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-0bb75a5c-32be-499b-9a49-1fa4a70add80 req-3588cbd0-66c4-44a3-941c-ab4370352b02 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:09.686381 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-0bb75a5c-32be-499b-9a49-1fa4a70add80 req-3588cbd0-66c4-44a3-941c-ab4370352b02 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:09.727844 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-0bb75a5c-32be-499b-9a49-1fa4a70add80 req-3588cbd0-66c4-44a3-941c-ab4370352b02 service nova] Creating event network-vif-deleted:06a72144-d46d-42ad-aef8-3b655cd2b4c6 for instance ec63aa76-1efa-45ed-8e4d-89794690776f on hv-cinder-78693 Apr 20 18:35:09.796047 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-0bb75a5c-32be-499b-9a49-1fa4a70add80 req-3588cbd0-66c4-44a3-941c-ab4370352b02 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171420 Apr 20 18:35:09.796756 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 262/529] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:35:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:35:09.803315 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a7d0086e-b555-4c55-a15d-0cb8ec1c185d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:09.804151 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a7d0086e-b555-4c55-a15d-0cb8ec1c185d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:09.816178 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a7d0086e-b555-4c55-a15d-0cb8ec1c185d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:09.817617 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a7d0086e-b555-4c55-a15d-0cb8ec1c185d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:09.819506 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a7d0086e-b555-4c55-a15d-0cb8ec1c185d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:09.820018 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a7d0086e-b555-4c55-a15d-0cb8ec1c185d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:09.874079 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b9cbb6d5-6e76-4185-b246-061f34eb55b8 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:09.886764 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b9cbb6d5-6e76-4185-b246-061f34eb55b8 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f" status: 200 len: 1303 microversion: 2.1 time: 0.334893 Apr 20 18:35:09.887848 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 268/530] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:09 2021] GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f => generated 1303 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:09.894101 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-942d6164-454c-4c32-8bc8-d63b35f68f1e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:09.894916 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-942d6164-454c-4c32-8bc8-d63b35f68f1e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:09.916443 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-942d6164-454c-4c32-8bc8-d63b35f68f1e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:09.917057 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-942d6164-454c-4c32-8bc8-d63b35f68f1e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:09.918665 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-942d6164-454c-4c32-8bc8-d63b35f68f1e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:09.919520 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-942d6164-454c-4c32-8bc8-d63b35f68f1e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:10.117439 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a7d0086e-b555-4c55-a15d-0cb8ec1c185d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:10.129201 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a7d0086e-b555-4c55-a15d-0cb8ec1c185d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:10.131836 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a7d0086e-b555-4c55-a15d-0cb8ec1c185d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:10.132929 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a7d0086e-b555-4c55-a15d-0cb8ec1c185d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1738 microversion: 2.20 time: 0.334941 Apr 20 18:35:10.133614 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 263/531] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:09 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1738 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:10.556158 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b6537c31-4069-4174-a094-f9a74680c277 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:10.556836 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b6537c31-4069-4174-a094-f9a74680c277 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:10.567937 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b6537c31-4069-4174-a094-f9a74680c277 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:10.569343 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b6537c31-4069-4174-a094-f9a74680c277 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:10.570992 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b6537c31-4069-4174-a094-f9a74680c277 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:10.572179 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b6537c31-4069-4174-a094-f9a74680c277 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:10.602312 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-942d6164-454c-4c32-8bc8-d63b35f68f1e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:10.619733 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-942d6164-454c-4c32-8bc8-d63b35f68f1e tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1511 microversion: 2.1 time: 0.730376 Apr 20 18:35:10.620393 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 269/532] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:09 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1511 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:10.648159 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b800be18-bb61-4c74-9f7f-8360159ae45f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:10.650384 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b800be18-bb61-4c74-9f7f-8360159ae45f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:10.676071 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b800be18-bb61-4c74-9f7f-8360159ae45f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:10.677235 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b800be18-bb61-4c74-9f7f-8360159ae45f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:10.678474 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b800be18-bb61-4c74-9f7f-8360159ae45f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:10.679283 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b800be18-bb61-4c74-9f7f-8360159ae45f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:10.987244 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b6537c31-4069-4174-a094-f9a74680c277 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:11.003860 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b6537c31-4069-4174-a094-f9a74680c277 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235" status: 200 len: 1501 microversion: 2.1 time: 0.452289 Apr 20 18:35:11.005026 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 264/533] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:10 2021] GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235 => generated 1501 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:11.010992 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-00100751-9dcf-484d-a162-006befd11db4 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:11.015007 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-00100751-9dcf-484d-a162-006befd11db4 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: ec63aa76-1efa-45ed-8e4d-89794690776f] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:11.024541 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-00100751-9dcf-484d-a162-006befd11db4 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:11.025316 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-00100751-9dcf-484d-a162-006befd11db4 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:11.026398 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-00100751-9dcf-484d-a162-006befd11db4 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:11.027053 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-00100751-9dcf-484d-a162-006befd11db4 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:11.086973 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-00100751-9dcf-484d-a162-006befd11db4 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] HTTP exception thrown: Instance ec63aa76-1efa-45ed-8e4d-89794690776f could not be found. Apr 20 18:35:11.087941 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-00100751-9dcf-484d-a162-006befd11db4 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Returning 404 to user: Instance ec63aa76-1efa-45ed-8e4d-89794690776f could not be found. {{(pid=100593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:35:11.089027 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-00100751-9dcf-484d-a162-006befd11db4 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f" status: 404 len: 111 microversion: 2.1 time: 0.082184 Apr 20 18:35:11.089882 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 265/534] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:11 2021] GET /compute/v2.1/servers/ec63aa76-1efa-45ed-8e4d-89794690776f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:35:11.168878 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8ada4d0e-af99-4617-b015-725c57c3bdff tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:11.169658 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8ada4d0e-af99-4617-b015-725c57c3bdff tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:11.191228 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8ada4d0e-af99-4617-b015-725c57c3bdff tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:11.191228 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8ada4d0e-af99-4617-b015-725c57c3bdff tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:11.191228 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8ada4d0e-af99-4617-b015-725c57c3bdff tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:11.191228 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8ada4d0e-af99-4617-b015-725c57c3bdff tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:11.335998 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:35:11.336484 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: Tue Apr 20 18:35:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b (ip 10.222.0.25) !!! Apr 20 18:35:11.837841 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b800be18-bb61-4c74-9f7f-8360159ae45f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:11.850179 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b800be18-bb61-4c74-9f7f-8360159ae45f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1566 microversion: 2.1 time: 1.206634 Apr 20 18:35:11.851107 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 270/535] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:10 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1566 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:11.856592 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6459e8fb-ad59-4cd9-a8b5-060139c35451 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:11.857743 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6459e8fb-ad59-4cd9-a8b5-060139c35451 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:11.899108 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6459e8fb-ad59-4cd9-a8b5-060139c35451 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:11.904749 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6459e8fb-ad59-4cd9-a8b5-060139c35451 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:11.905886 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6459e8fb-ad59-4cd9-a8b5-060139c35451 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:11.906414 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6459e8fb-ad59-4cd9-a8b5-060139c35451 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:11.932206 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8ada4d0e-af99-4617-b015-725c57c3bdff tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:11.946881 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8ada4d0e-af99-4617-b015-725c57c3bdff tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:11.948455 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8ada4d0e-af99-4617-b015-725c57c3bdff tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:11.949749 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8ada4d0e-af99-4617-b015-725c57c3bdff tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1738 microversion: 2.20 time: 0.800411 Apr 20 18:35:11.950376 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 266/536] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:11 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1738 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:11.958564 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-38c634bc-3f8a-4709-8463-37601a900041 req-847c34ac-2115-4dcc-ae5e-43aae4506f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cc910f0-1c12-4462-acd1-89bb382a4005", "name": "network-vif-deleted", "tag": "432b4968-6879-45da-a066-9f94c7121c73"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:35:11.960819 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:35:11.960819 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:35:11.989226 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-38c634bc-3f8a-4709-8463-37601a900041 req-847c34ac-2115-4dcc-ae5e-43aae4506f38 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:11.990720 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-38c634bc-3f8a-4709-8463-37601a900041 req-847c34ac-2115-4dcc-ae5e-43aae4506f38 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:12.028711 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-38c634bc-3f8a-4709-8463-37601a900041 req-847c34ac-2115-4dcc-ae5e-43aae4506f38 service nova] Creating event network-vif-deleted:432b4968-6879-45da-a066-9f94c7121c73 for instance 6cc910f0-1c12-4462-acd1-89bb382a4005 on hv-cinder-78693 Apr 20 18:35:12.034973 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-38c634bc-3f8a-4709-8463-37601a900041 req-847c34ac-2115-4dcc-ae5e-43aae4506f38 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082841 Apr 20 18:35:12.036047 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 267/537] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:35:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:35:12.042210 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-cba27d00-1296-4229-b082-3cdd06d0a176 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:12.043339 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-cba27d00-1296-4229-b082-3cdd06d0a176 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:12.052935 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cba27d00-1296-4229-b082-3cdd06d0a176 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:12.053913 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cba27d00-1296-4229-b082-3cdd06d0a176 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:12.055281 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cba27d00-1296-4229-b082-3cdd06d0a176 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:12.056009 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cba27d00-1296-4229-b082-3cdd06d0a176 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:12.253473 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6459e8fb-ad59-4cd9-a8b5-060139c35451 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:12.276401 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6459e8fb-ad59-4cd9-a8b5-060139c35451 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1469 microversion: 2.1 time: 0.423393 Apr 20 18:35:12.278562 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 271/538] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:11 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1469 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:12.816027 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-cba27d00-1296-4229-b082-3cdd06d0a176 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:12.830470 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-cba27d00-1296-4229-b082-3cdd06d0a176 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235" status: 200 len: 1501 microversion: 2.1 time: 0.792760 Apr 20 18:35:12.831416 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 268/539] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:12 2021] GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235 => generated 1501 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:12.869576 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f40ecc11-34b7-40ff-b4d8-24622712c306 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:12.869880 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f40ecc11-34b7-40ff-b4d8-24622712c306 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:12.893353 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f40ecc11-34b7-40ff-b4d8-24622712c306 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:12.894452 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f40ecc11-34b7-40ff-b4d8-24622712c306 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:12.897371 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f40ecc11-34b7-40ff-b4d8-24622712c306 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:12.898984 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f40ecc11-34b7-40ff-b4d8-24622712c306 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:12.983773 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-daeac89e-aa44-41c1-8834-ebb79e5aa1b0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:12.986117 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-daeac89e-aa44-41c1-8834-ebb79e5aa1b0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:13.000062 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-daeac89e-aa44-41c1-8834-ebb79e5aa1b0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:13.001696 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-daeac89e-aa44-41c1-8834-ebb79e5aa1b0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:13.003270 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-daeac89e-aa44-41c1-8834-ebb79e5aa1b0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:13.004184 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-daeac89e-aa44-41c1-8834-ebb79e5aa1b0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:13.241606 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f40ecc11-34b7-40ff-b4d8-24622712c306 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:13.261134 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f40ecc11-34b7-40ff-b4d8-24622712c306 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1566 microversion: 2.1 time: 0.395785 Apr 20 18:35:13.262471 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 272/540] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:12 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1566 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:13.285114 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-053e6ca0-c0a2-4a48-826d-88bdc98b5c71 req-4e90a359-b6f3-4593-972c-a42ec88be904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c3b12a-8dae-44c3-b48e-4ec18cd0e235", "name": "network-vif-deleted", "tag": "9a853972-a5f7-485a-a061-21bb26950d18"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:35:13.290232 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:35:13.290232 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:35:13.306824 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-053e6ca0-c0a2-4a48-826d-88bdc98b5c71 req-4e90a359-b6f3-4593-972c-a42ec88be904 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:13.307555 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-053e6ca0-c0a2-4a48-826d-88bdc98b5c71 req-4e90a359-b6f3-4593-972c-a42ec88be904 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:13.340842 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-053e6ca0-c0a2-4a48-826d-88bdc98b5c71 req-4e90a359-b6f3-4593-972c-a42ec88be904 service nova] Creating event network-vif-deleted:9a853972-a5f7-485a-a061-21bb26950d18 for instance 28c3b12a-8dae-44c3-b48e-4ec18cd0e235 on hv-cinder-78693 Apr 20 18:35:13.347376 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-053e6ca0-c0a2-4a48-826d-88bdc98b5c71 req-4e90a359-b6f3-4593-972c-a42ec88be904 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082413 Apr 20 18:35:13.348814 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 273/541] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:35:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:35:13.351330 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-daeac89e-aa44-41c1-8834-ebb79e5aa1b0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:13.364366 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9a2e104c-69b0-4ff6-a7ad-3fc1590e1340 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:13.366957 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9a2e104c-69b0-4ff6-a7ad-3fc1590e1340 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:13.374375 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-daeac89e-aa44-41c1-8834-ebb79e5aa1b0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:13.377133 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-daeac89e-aa44-41c1-8834-ebb79e5aa1b0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:13.378923 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-daeac89e-aa44-41c1-8834-ebb79e5aa1b0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1720 microversion: 2.20 time: 0.405175 Apr 20 18:35:13.380046 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 269/542] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:12 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1720 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:13.383828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9a2e104c-69b0-4ff6-a7ad-3fc1590e1340 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:13.384733 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9a2e104c-69b0-4ff6-a7ad-3fc1590e1340 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:13.386366 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9a2e104c-69b0-4ff6-a7ad-3fc1590e1340 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:13.387261 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9a2e104c-69b0-4ff6-a7ad-3fc1590e1340 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:13.508246 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9a2e104c-69b0-4ff6-a7ad-3fc1590e1340 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:13.508766 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9a2e104c-69b0-4ff6-a7ad-3fc1590e1340 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:13.509295 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-9a2e104c-69b0-4ff6-a7ad-3fc1590e1340 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lazy-loading 'fault' on Instance uuid 6cc910f0-1c12-4462-acd1-89bb382a4005 {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:35:13.604634 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9a2e104c-69b0-4ff6-a7ad-3fc1590e1340 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:13.614439 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9a2e104c-69b0-4ff6-a7ad-3fc1590e1340 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1306 microversion: 2.1 time: 0.259504 Apr 20 18:35:13.615792 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 274/543] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:13 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1306 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:13.858862 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a59570dd-a101-4e1b-ad64-4f011a986cce tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:13.859727 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a59570dd-a101-4e1b-ad64-4f011a986cce tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:13.869827 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a59570dd-a101-4e1b-ad64-4f011a986cce tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:13.870321 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a59570dd-a101-4e1b-ad64-4f011a986cce tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:13.871954 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a59570dd-a101-4e1b-ad64-4f011a986cce tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:13.872262 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a59570dd-a101-4e1b-ad64-4f011a986cce tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:14.022491 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a59570dd-a101-4e1b-ad64-4f011a986cce tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:14.032555 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a59570dd-a101-4e1b-ad64-4f011a986cce tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235" status: 200 len: 1459 microversion: 2.1 time: 0.178090 Apr 20 18:35:14.033227 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 270/544] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:13 2021] GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235 => generated 1459 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:14.281998 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6131f79e-a7fe-4c15-b1b5-e0f7b59a9ac6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:14.283187 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6131f79e-a7fe-4c15-b1b5-e0f7b59a9ac6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:14.296072 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6131f79e-a7fe-4c15-b1b5-e0f7b59a9ac6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:14.296072 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6131f79e-a7fe-4c15-b1b5-e0f7b59a9ac6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:14.297572 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6131f79e-a7fe-4c15-b1b5-e0f7b59a9ac6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:14.298258 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6131f79e-a7fe-4c15-b1b5-e0f7b59a9ac6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:14.401643 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-46bfd549-cfc7-47d7-995c-05c7627f2eaa tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:14.402474 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-46bfd549-cfc7-47d7-995c-05c7627f2eaa tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:14.417522 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-46bfd549-cfc7-47d7-995c-05c7627f2eaa tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:14.418029 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-46bfd549-cfc7-47d7-995c-05c7627f2eaa tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:14.418900 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-46bfd549-cfc7-47d7-995c-05c7627f2eaa tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:14.419777 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-46bfd549-cfc7-47d7-995c-05c7627f2eaa tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:14.558247 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6131f79e-a7fe-4c15-b1b5-e0f7b59a9ac6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:14.569190 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6131f79e-a7fe-4c15-b1b5-e0f7b59a9ac6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1566 microversion: 2.1 time: 0.292452 Apr 20 18:35:14.569907 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 275/545] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:14 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1566 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:14.632558 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-383a93c7-56c2-40a3-969a-364f2f055201 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:14.633568 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-383a93c7-56c2-40a3-969a-364f2f055201 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:14.642015 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-383a93c7-56c2-40a3-969a-364f2f055201 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:14.642533 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-383a93c7-56c2-40a3-969a-364f2f055201 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:14.643405 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-383a93c7-56c2-40a3-969a-364f2f055201 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:14.643907 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-383a93c7-56c2-40a3-969a-364f2f055201 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:14.704305 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-46bfd549-cfc7-47d7-995c-05c7627f2eaa tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:14.722851 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-46bfd549-cfc7-47d7-995c-05c7627f2eaa tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:14.726289 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-46bfd549-cfc7-47d7-995c-05c7627f2eaa tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:14.727294 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-383a93c7-56c2-40a3-969a-364f2f055201 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:14.727826 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-383a93c7-56c2-40a3-969a-364f2f055201 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:14.728354 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-383a93c7-56c2-40a3-969a-364f2f055201 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lazy-loading 'fault' on Instance uuid 6cc910f0-1c12-4462-acd1-89bb382a4005 {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:35:14.728520 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-46bfd549-cfc7-47d7-995c-05c7627f2eaa tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1720 microversion: 2.20 time: 0.332162 Apr 20 18:35:14.730222 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 271/546] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:14 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1720 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:14.828999 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-383a93c7-56c2-40a3-969a-364f2f055201 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:14.846554 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-383a93c7-56c2-40a3-969a-364f2f055201 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 200 len: 1306 microversion: 2.1 time: 0.217641 Apr 20 18:35:14.847672 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 276/547] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:14 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 1306 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:35:15.067351 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-bbd864cc-7c2d-4600-a1b5-20f3117dd147 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:15.069938 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-bbd864cc-7c2d-4600-a1b5-20f3117dd147 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:15.089357 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bbd864cc-7c2d-4600-a1b5-20f3117dd147 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:15.090492 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bbd864cc-7c2d-4600-a1b5-20f3117dd147 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:15.092612 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bbd864cc-7c2d-4600-a1b5-20f3117dd147 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:15.093700 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bbd864cc-7c2d-4600-a1b5-20f3117dd147 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:15.225255 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bbd864cc-7c2d-4600-a1b5-20f3117dd147 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:15.225775 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bbd864cc-7c2d-4600-a1b5-20f3117dd147 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:15.226313 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-bbd864cc-7c2d-4600-a1b5-20f3117dd147 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lazy-loading 'fault' on Instance uuid 28c3b12a-8dae-44c3-b48e-4ec18cd0e235 {{(pid=100593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:35:15.384127 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-bbd864cc-7c2d-4600-a1b5-20f3117dd147 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa06da535517426ca314d698b0067e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977d101190a341ceb8e52a3b3e91678f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:15.422596 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-bbd864cc-7c2d-4600-a1b5-20f3117dd147 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235" status: 200 len: 1303 microversion: 2.1 time: 0.365222 Apr 20 18:35:15.427004 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 272/548] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:15 2021] GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235 => generated 1303 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:15.590815 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a387a24e-3e1b-4d42-9108-923716aa209f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:15.591653 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a387a24e-3e1b-4d42-9108-923716aa209f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:15.609860 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a387a24e-3e1b-4d42-9108-923716aa209f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:15.610899 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a387a24e-3e1b-4d42-9108-923716aa209f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:15.612148 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a387a24e-3e1b-4d42-9108-923716aa209f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:15.613052 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a387a24e-3e1b-4d42-9108-923716aa209f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:15.751021 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ccc37586-cb34-4be8-bf5f-3f26386b6563 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:15.752015 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ccc37586-cb34-4be8-bf5f-3f26386b6563 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:15.761655 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ccc37586-cb34-4be8-bf5f-3f26386b6563 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:15.762376 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ccc37586-cb34-4be8-bf5f-3f26386b6563 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:15.763621 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ccc37586-cb34-4be8-bf5f-3f26386b6563 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:15.764323 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ccc37586-cb34-4be8-bf5f-3f26386b6563 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:16.221209 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a387a24e-3e1b-4d42-9108-923716aa209f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:16.232534 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a387a24e-3e1b-4d42-9108-923716aa209f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1566 microversion: 2.1 time: 0.647302 Apr 20 18:35:16.233702 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 277/549] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:15 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1566 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:16.248715 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5ae97935-9a61-49d3-b099-c40039d73750 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:16.249943 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5ae97935-9a61-49d3-b099-c40039d73750 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 6cc910f0-1c12-4462-acd1-89bb382a4005] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:16.261177 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5ae97935-9a61-49d3-b099-c40039d73750 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:16.262012 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5ae97935-9a61-49d3-b099-c40039d73750 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:16.263110 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5ae97935-9a61-49d3-b099-c40039d73750 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:16.263767 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5ae97935-9a61-49d3-b099-c40039d73750 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:16.361561 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-5ae97935-9a61-49d3-b099-c40039d73750 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] HTTP exception thrown: Instance 6cc910f0-1c12-4462-acd1-89bb382a4005 could not be found. Apr 20 18:35:16.363088 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5ae97935-9a61-49d3-b099-c40039d73750 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Returning 404 to user: Instance 6cc910f0-1c12-4462-acd1-89bb382a4005 could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:35:16.368261 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5ae97935-9a61-49d3-b099-c40039d73750 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005" status: 404 len: 111 microversion: 2.1 time: 0.129479 Apr 20 18:35:16.369919 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 278/550] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:16 2021] GET /compute/v2.1/servers/6cc910f0-1c12-4462-acd1-89bb382a4005 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:35:16.400232 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-ae9434bd-46b2-4912-84b5-a9d6e2a10f91 req-ec1d0207-ae37-4c67-b54a-4a39b29e63b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e532f85-bed6-43d3-969d-3a2688b4638b", "name": "network-vif-unplugged", "status": "completed", "tag": "36707b77-0efd-41e0-9dc6-6332c175126e"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:35:16.404398 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:35:16.404398 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:35:16.426308 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-ae9434bd-46b2-4912-84b5-a9d6e2a10f91 req-ec1d0207-ae37-4c67-b54a-4a39b29e63b6 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:16.428265 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-ae9434bd-46b2-4912-84b5-a9d6e2a10f91 req-ec1d0207-ae37-4c67-b54a-4a39b29e63b6 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:16.469937 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-ae9434bd-46b2-4912-84b5-a9d6e2a10f91 req-ec1d0207-ae37-4c67-b54a-4a39b29e63b6 service nova] Creating event network-vif-unplugged:36707b77-0efd-41e0-9dc6-6332c175126e for instance 1e532f85-bed6-43d3-969d-3a2688b4638b on hv-cinder-78693 Apr 20 18:35:16.493181 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-ae9434bd-46b2-4912-84b5-a9d6e2a10f91 req-ec1d0207-ae37-4c67-b54a-4a39b29e63b6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114436 Apr 20 18:35:16.495016 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 279/551] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:35:16 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:35:16.515188 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3f33e240-6f96-4059-a270-fca7a535f972 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:16.517020 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3f33e240-6f96-4059-a270-fca7a535f972 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] [instance: 28c3b12a-8dae-44c3-b48e-4ec18cd0e235] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:16.537492 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3f33e240-6f96-4059-a270-fca7a535f972 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:16.538882 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3f33e240-6f96-4059-a270-fca7a535f972 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:16.540678 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3f33e240-6f96-4059-a270-fca7a535f972 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:16.541833 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3f33e240-6f96-4059-a270-fca7a535f972 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:16.580075 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ccc37586-cb34-4be8-bf5f-3f26386b6563 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:16.592968 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ccc37586-cb34-4be8-bf5f-3f26386b6563 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:16.605817 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ccc37586-cb34-4be8-bf5f-3f26386b6563 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:16.615462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ccc37586-cb34-4be8-bf5f-3f26386b6563 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1720 microversion: 2.20 time: 0.868349 Apr 20 18:35:16.617039 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 273/552] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:15 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1720 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:35:16.691824 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-3f33e240-6f96-4059-a270-fca7a535f972 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] HTTP exception thrown: Instance 28c3b12a-8dae-44c3-b48e-4ec18cd0e235 could not be found. Apr 20 18:35:16.693659 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3f33e240-6f96-4059-a270-fca7a535f972 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] Returning 404 to user: Instance 28c3b12a-8dae-44c3-b48e-4ec18cd0e235 could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:35:16.695428 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3f33e240-6f96-4059-a270-fca7a535f972 tempest-VolumesActionsTest-1115727167 tempest-VolumesActionsTest-1115727167-project] 10.222.0.25 "GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235" status: 404 len: 111 microversion: 2.1 time: 0.193439 Apr 20 18:35:16.696863 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 280/553] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:16 2021] GET /compute/v2.1/servers/28c3b12a-8dae-44c3-b48e-4ec18cd0e235 => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:35:17.253818 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b87c261e-862e-4861-a5df-c0890f85c314 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:17.254675 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b87c261e-862e-4861-a5df-c0890f85c314 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:17.264816 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b87c261e-862e-4861-a5df-c0890f85c314 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:17.265648 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b87c261e-862e-4861-a5df-c0890f85c314 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:17.266685 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b87c261e-862e-4861-a5df-c0890f85c314 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:17.267241 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b87c261e-862e-4861-a5df-c0890f85c314 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:17.517027 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b87c261e-862e-4861-a5df-c0890f85c314 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:17.528111 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b87c261e-862e-4861-a5df-c0890f85c314 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1566 microversion: 2.1 time: 0.278924 Apr 20 18:35:17.528899 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 274/554] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:17 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1566 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:17.650869 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b2af9603-c565-439e-a05f-113c1e81c524 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:17.651544 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b2af9603-c565-439e-a05f-113c1e81c524 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:17.659724 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b2af9603-c565-439e-a05f-113c1e81c524 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:17.660224 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b2af9603-c565-439e-a05f-113c1e81c524 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:17.662305 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b2af9603-c565-439e-a05f-113c1e81c524 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:17.662796 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b2af9603-c565-439e-a05f-113c1e81c524 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:17.903522 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-833ae842-de41-45c9-88d2-115d3306d025 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:17.904080 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-833ae842-de41-45c9-88d2-115d3306d025 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:17.913955 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-833ae842-de41-45c9-88d2-115d3306d025 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:17.914721 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-833ae842-de41-45c9-88d2-115d3306d025 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:17.915797 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-833ae842-de41-45c9-88d2-115d3306d025 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:17.916444 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-833ae842-de41-45c9-88d2-115d3306d025 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:17.964004 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b2af9603-c565-439e-a05f-113c1e81c524 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:17.977665 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b2af9603-c565-439e-a05f-113c1e81c524 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:17.980780 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b2af9603-c565-439e-a05f-113c1e81c524 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:17.982617 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b2af9603-c565-439e-a05f-113c1e81c524 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1720 microversion: 2.20 time: 0.336043 Apr 20 18:35:17.983466 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 281/555] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:17 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1720 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:18.021024 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-833ae842-de41-45c9-88d2-115d3306d025 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Going to try to terminate instance {{(pid=100593) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:35:18.171761 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-833ae842-de41-45c9-88d2-115d3306d025 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "DELETE /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 204 len: 0 microversion: 2.1 time: 0.271627 Apr 20 18:35:18.172695 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 275/556] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:35:17 2021] DELETE /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 20 18:35:18.182089 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f17a8799-9c5e-41a3-885b-295ca1de503c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:18.183145 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f17a8799-9c5e-41a3-885b-295ca1de503c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:18.200461 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f17a8799-9c5e-41a3-885b-295ca1de503c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:18.201264 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f17a8799-9c5e-41a3-885b-295ca1de503c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:18.202674 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f17a8799-9c5e-41a3-885b-295ca1de503c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:18.203444 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f17a8799-9c5e-41a3-885b-295ca1de503c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:18.475274 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f17a8799-9c5e-41a3-885b-295ca1de503c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:18.484906 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f17a8799-9c5e-41a3-885b-295ca1de503c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 200 len: 1513 microversion: 2.1 time: 0.307934 Apr 20 18:35:18.485598 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 282/557] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:18 2021] GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 1513 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:18.548996 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9c7cd559-839c-4ff3-920f-300f2a8ea1f3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:18.550106 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9c7cd559-839c-4ff3-920f-300f2a8ea1f3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:18.566051 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9c7cd559-839c-4ff3-920f-300f2a8ea1f3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:18.566999 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9c7cd559-839c-4ff3-920f-300f2a8ea1f3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:18.569215 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9c7cd559-839c-4ff3-920f-300f2a8ea1f3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:18.570198 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9c7cd559-839c-4ff3-920f-300f2a8ea1f3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:18.815974 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9c7cd559-839c-4ff3-920f-300f2a8ea1f3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:18.827157 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9c7cd559-839c-4ff3-920f-300f2a8ea1f3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1546 microversion: 2.1 time: 0.283383 Apr 20 18:35:18.827837 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 276/558] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:18 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1546 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:18.846821 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4c4a2780-11f5-44bd-ae43-0863051fa300 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:18.847384 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4c4a2780-11f5-44bd-ae43-0863051fa300 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:18.856458 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4c4a2780-11f5-44bd-ae43-0863051fa300 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:18.856968 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4c4a2780-11f5-44bd-ae43-0863051fa300 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:18.857883 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4c4a2780-11f5-44bd-ae43-0863051fa300 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:18.858387 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4c4a2780-11f5-44bd-ae43-0863051fa300 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:19.005375 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-20774345-a143-4dfc-b4ee-d128a4a38421 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:19.006436 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-20774345-a143-4dfc-b4ee-d128a4a38421 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:19.014872 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-20774345-a143-4dfc-b4ee-d128a4a38421 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:19.015384 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-20774345-a143-4dfc-b4ee-d128a4a38421 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:19.016306 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-20774345-a143-4dfc-b4ee-d128a4a38421 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:19.016806 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-20774345-a143-4dfc-b4ee-d128a4a38421 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:19.068256 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-4c4a2780-11f5-44bd-ae43-0863051fa300 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] HTTP exception thrown: Cannot 'detach_volume' instance aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d while it is in vm_state rescued Apr 20 18:35:19.068924 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4c4a2780-11f5-44bd-ae43-0863051fa300 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Returning 409 to user: Cannot 'detach_volume' instance aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d while it is in vm_state rescued {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:35:19.069923 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4c4a2780-11f5-44bd-ae43-0863051fa300 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d/os-volume_attachments/4073df06-b328-47bf-8ee8-0052772e4934" status: 409 len: 152 microversion: 2.1 time: 0.227530 Apr 20 18:35:19.070605 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 283/559] 10.222.0.25 () {58 vars in 1406 bytes} [Tue Apr 20 18:35:18 2021] DELETE /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d/os-volume_attachments/4073df06-b328-47bf-8ee8-0052772e4934 => generated 152 bytes in 229 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 20 18:35:19.080813 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-830e06b1-0d7a-4a4d-93a0-e4aef01a19d4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:35:19.081990 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-830e06b1-0d7a-4a4d-93a0-e4aef01a19d4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:19.098443 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-830e06b1-0d7a-4a4d-93a0-e4aef01a19d4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:19.099980 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-830e06b1-0d7a-4a4d-93a0-e4aef01a19d4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:19.101987 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-830e06b1-0d7a-4a4d-93a0-e4aef01a19d4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:19.102896 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-830e06b1-0d7a-4a4d-93a0-e4aef01a19d4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:19.262404 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-830e06b1-0d7a-4a4d-93a0-e4aef01a19d4 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "POST /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d/action" status: 202 len: 0 microversion: 2.1 time: 0.186754 Apr 20 18:35:19.266068 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 284/560] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:35:19 2021] POST /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:35:19.266286 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-20774345-a143-4dfc-b4ee-d128a4a38421 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:19.273598 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-88bb2064-b3ea-4b1e-bdf6-f0844a1c19ff tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:19.274403 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-20774345-a143-4dfc-b4ee-d128a4a38421 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:19.274558 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-88bb2064-b3ea-4b1e-bdf6-f0844a1c19ff tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:19.275953 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-20774345-a143-4dfc-b4ee-d128a4a38421 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:19.277213 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-20774345-a143-4dfc-b4ee-d128a4a38421 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1720 microversion: 2.20 time: 0.276381 Apr 20 18:35:19.277889 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 277/561] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:18 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1720 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:19.282835 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-88bb2064-b3ea-4b1e-bdf6-f0844a1c19ff tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:19.283348 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-88bb2064-b3ea-4b1e-bdf6-f0844a1c19ff tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:19.284207 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-88bb2064-b3ea-4b1e-bdf6-f0844a1c19ff tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:19.284698 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-88bb2064-b3ea-4b1e-bdf6-f0844a1c19ff tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:19.504921 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-77f69365-eb84-4fad-bca7-978dfc976ba1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:19.506527 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-77f69365-eb84-4fad-bca7-978dfc976ba1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:19.515149 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-77f69365-eb84-4fad-bca7-978dfc976ba1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:19.515685 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-77f69365-eb84-4fad-bca7-978dfc976ba1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:19.516556 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-77f69365-eb84-4fad-bca7-978dfc976ba1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:19.517050 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-77f69365-eb84-4fad-bca7-978dfc976ba1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:19.559970 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-88bb2064-b3ea-4b1e-bdf6-f0844a1c19ff tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:19.570853 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-88bb2064-b3ea-4b1e-bdf6-f0844a1c19ff tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1554 microversion: 2.1 time: 0.302766 Apr 20 18:35:19.571701 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 285/562] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:19 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1554 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:35:19.778952 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-77f69365-eb84-4fad-bca7-978dfc976ba1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:19.789810 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-77f69365-eb84-4fad-bca7-978dfc976ba1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 200 len: 1513 microversion: 2.1 time: 0.289320 Apr 20 18:35:19.790477 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 278/563] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:19 2021] GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 1513 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:35:20.298069 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4451d913-70eb-40ba-af3c-5a38ffc04d07 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:20.298825 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4451d913-70eb-40ba-af3c-5a38ffc04d07 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:20.307901 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4451d913-70eb-40ba-af3c-5a38ffc04d07 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:20.308409 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4451d913-70eb-40ba-af3c-5a38ffc04d07 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:20.309261 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4451d913-70eb-40ba-af3c-5a38ffc04d07 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:20.309805 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4451d913-70eb-40ba-af3c-5a38ffc04d07 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:20.574212 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4451d913-70eb-40ba-af3c-5a38ffc04d07 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:20.586384 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4451d913-70eb-40ba-af3c-5a38ffc04d07 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:20.588200 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4451d913-70eb-40ba-af3c-5a38ffc04d07 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:20.589847 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4451d913-70eb-40ba-af3c-5a38ffc04d07 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1720 microversion: 2.20 time: 0.295794 Apr 20 18:35:20.590172 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 286/564] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:20 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1720 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:20.591749 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-90f50d88-0730-4111-b653-d3e9f36dd7d5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:20.592497 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-90f50d88-0730-4111-b653-d3e9f36dd7d5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:20.601027 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-90f50d88-0730-4111-b653-d3e9f36dd7d5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:20.601573 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-90f50d88-0730-4111-b653-d3e9f36dd7d5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:20.602430 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-90f50d88-0730-4111-b653-d3e9f36dd7d5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:20.602927 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-90f50d88-0730-4111-b653-d3e9f36dd7d5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:20.815201 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-562ede03-a711-4e45-8fcf-137e6bf9d4bb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:20.816477 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-562ede03-a711-4e45-8fcf-137e6bf9d4bb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:20.827634 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-562ede03-a711-4e45-8fcf-137e6bf9d4bb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:20.828144 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-562ede03-a711-4e45-8fcf-137e6bf9d4bb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:20.829016 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-562ede03-a711-4e45-8fcf-137e6bf9d4bb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:20.829566 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-562ede03-a711-4e45-8fcf-137e6bf9d4bb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:20.851462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-90f50d88-0730-4111-b653-d3e9f36dd7d5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:20.862893 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-90f50d88-0730-4111-b653-d3e9f36dd7d5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1554 microversion: 2.1 time: 0.275367 Apr 20 18:35:20.863657 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 279/565] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:20 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1554 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:35:21.062895 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-562ede03-a711-4e45-8fcf-137e6bf9d4bb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:21.072754 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-562ede03-a711-4e45-8fcf-137e6bf9d4bb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 200 len: 1513 microversion: 2.1 time: 0.265797 Apr 20 18:35:21.073535 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 287/566] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:20 2021] GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 1513 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:35:21.627913 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ac7d203a-2bfb-4303-b035-3ffc2e028b09 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:21.631499 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ac7d203a-2bfb-4303-b035-3ffc2e028b09 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:21.640129 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ac7d203a-2bfb-4303-b035-3ffc2e028b09 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:21.640645 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ac7d203a-2bfb-4303-b035-3ffc2e028b09 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:21.641537 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ac7d203a-2bfb-4303-b035-3ffc2e028b09 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:21.642221 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ac7d203a-2bfb-4303-b035-3ffc2e028b09 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:21.889382 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2357263c-90e0-4f9c-859a-0dc7afb5634d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:21.890840 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2357263c-90e0-4f9c-859a-0dc7afb5634d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:21.907025 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2357263c-90e0-4f9c-859a-0dc7afb5634d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:21.907634 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2357263c-90e0-4f9c-859a-0dc7afb5634d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:21.908642 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2357263c-90e0-4f9c-859a-0dc7afb5634d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:21.909212 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2357263c-90e0-4f9c-859a-0dc7afb5634d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:21.944932 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ac7d203a-2bfb-4303-b035-3ffc2e028b09 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:21.955664 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ac7d203a-2bfb-4303-b035-3ffc2e028b09 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:21.957338 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ac7d203a-2bfb-4303-b035-3ffc2e028b09 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:21.959223 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ac7d203a-2bfb-4303-b035-3ffc2e028b09 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1723 microversion: 2.20 time: 0.339602 Apr 20 18:35:21.959900 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 280/567] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:21 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1723 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:35:21.980447 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7d61457b-0275-48e7-b3b3-2a907e32b67a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "772cc194-ad1f-4ef2-981d-0e5b23c87312"}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:35:21.981831 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7d61457b-0275-48e7-b3b3-2a907e32b67a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:21.991611 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7d61457b-0275-48e7-b3b3-2a907e32b67a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:21.992165 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7d61457b-0275-48e7-b3b3-2a907e32b67a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:21.993125 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7d61457b-0275-48e7-b3b3-2a907e32b67a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:21.993662 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7d61457b-0275-48e7-b3b3-2a907e32b67a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:22.154015 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2357263c-90e0-4f9c-859a-0dc7afb5634d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:22.172108 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2357263c-90e0-4f9c-859a-0dc7afb5634d tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1554 microversion: 2.1 time: 0.291407 Apr 20 18:35:22.173363 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 288/568] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:21 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1554 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:35:22.179782 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-966b2e5d-fb09-4a5a-85bb-d47f87af5c92 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:22.180883 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-966b2e5d-fb09-4a5a-85bb-d47f87af5c92 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:22.189438 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-966b2e5d-fb09-4a5a-85bb-d47f87af5c92 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:22.189955 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-966b2e5d-fb09-4a5a-85bb-d47f87af5c92 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:22.190824 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-966b2e5d-fb09-4a5a-85bb-d47f87af5c92 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:22.191326 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-966b2e5d-fb09-4a5a-85bb-d47f87af5c92 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:22.522326 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-966b2e5d-fb09-4a5a-85bb-d47f87af5c92 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:22.534183 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-966b2e5d-fb09-4a5a-85bb-d47f87af5c92 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 200 len: 1513 microversion: 2.1 time: 0.359247 Apr 20 18:35:22.535371 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 289/569] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:22 2021] GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 1513 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:22.632391 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7d61457b-0275-48e7-b3b3-2a907e32b67a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.656892 Apr 20 18:35:22.633757 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 281/570] 10.222.0.25 () {62 vars in 1354 bytes} [Tue Apr 20 18:35:21 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/os-volume_attachments => generated 188 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:35:22.747710 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f14665a3-4ba0-446f-9f3b-1fffcd3335a5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1897141343", "imageRef": "ba8326d8-5d1b-42a2-a65e-f1108a025e30", "flavorRef": "452", "networks": [{"uuid": "a8ad5c85-66fc-46e4-a059-80fb3de0af49"}]}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:35:22.764128 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5c42056b-31c4-4ade-88be-2dce29cc96af tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:35:22.764808 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5c42056b-31c4-4ade-88be-2dce29cc96af tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:22.773812 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5c42056b-31c4-4ade-88be-2dce29cc96af tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:22.774330 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5c42056b-31c4-4ade-88be-2dce29cc96af tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:22.775193 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5c42056b-31c4-4ade-88be-2dce29cc96af tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:22.775696 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5c42056b-31c4-4ade-88be-2dce29cc96af tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:22.869018 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.network.neutron [None req-f14665a3-4ba0-446f-9f3b-1fffcd3335a5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] validate_networks() for [('a8ad5c85-66fc-46e4-a059-80fb3de0af49', None, None, None)] {{(pid=100592) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:35:22.961963 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5c42056b-31c4-4ade-88be-2dce29cc96af tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action" status: 202 len: 0 microversion: 2.20 time: 0.201819 Apr 20 18:35:22.962593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 282/571] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:35:22 2021] POST /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 20 18:35:22.973452 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4bcb1458-abbd-4dcb-b218-843cd1987f1f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:22.974799 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4bcb1458-abbd-4dcb-b218-843cd1987f1f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:22.985315 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4bcb1458-abbd-4dcb-b218-843cd1987f1f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:22.985894 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4bcb1458-abbd-4dcb-b218-843cd1987f1f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:22.986783 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4bcb1458-abbd-4dcb-b218-843cd1987f1f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:22.987278 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4bcb1458-abbd-4dcb-b218-843cd1987f1f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:23.244065 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4bcb1458-abbd-4dcb-b218-843cd1987f1f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:23.256464 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4bcb1458-abbd-4dcb-b218-843cd1987f1f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:23.258516 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4bcb1458-abbd-4dcb-b218-843cd1987f1f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:23.259819 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4bcb1458-abbd-4dcb-b218-843cd1987f1f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1809 microversion: 2.20 time: 0.290560 Apr 20 18:35:23.260461 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 283/572] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:22 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1809 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:23.277939 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-08ee69f7-a154-4af2-988d-65f216fd38fe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:23.278625 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-08ee69f7-a154-4af2-988d-65f216fd38fe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:23.288253 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-08ee69f7-a154-4af2-988d-65f216fd38fe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:23.288775 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-08ee69f7-a154-4af2-988d-65f216fd38fe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:23.289725 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-08ee69f7-a154-4af2-988d-65f216fd38fe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:23.290269 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-08ee69f7-a154-4af2-988d-65f216fd38fe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:23.550625 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-08ee69f7-a154-4af2-988d-65f216fd38fe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:23.567002 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-08ee69f7-a154-4af2-988d-65f216fd38fe tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1554 microversion: 2.1 time: 0.292589 Apr 20 18:35:23.570497 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 284/573] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:23 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1554 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:23.582907 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b728e6f5-e72b-4af5-ba2e-e68e40ea0ba1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:23.585639 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b728e6f5-e72b-4af5-ba2e-e68e40ea0ba1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:23.604056 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b728e6f5-e72b-4af5-ba2e-e68e40ea0ba1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:23.606128 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b728e6f5-e72b-4af5-ba2e-e68e40ea0ba1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:23.608128 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b728e6f5-e72b-4af5-ba2e-e68e40ea0ba1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:23.609211 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b728e6f5-e72b-4af5-ba2e-e68e40ea0ba1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:23.711647 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-f14665a3-4ba0-446f-9f3b-1fffcd3335a5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Flavor limits 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:35:23.712504 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-f14665a3-4ba0-446f-9f3b-1fffcd3335a5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Image limits 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:35:23.712705 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-f14665a3-4ba0-446f-9f3b-1fffcd3335a5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Flavor pref 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:35:23.713186 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-f14665a3-4ba0-446f-9f3b-1fffcd3335a5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Image pref 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:35:23.713691 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-f14665a3-4ba0-446f-9f3b-1fffcd3335a5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:35:23.725261 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f14665a3-4ba0-446f-9f3b-1fffcd3335a5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:23.725807 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f14665a3-4ba0-446f-9f3b-1fffcd3335a5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:23.726718 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f14665a3-4ba0-446f-9f3b-1fffcd3335a5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:23.727224 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f14665a3-4ba0-446f-9f3b-1fffcd3335a5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:23.750330 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-f14665a3-4ba0-446f-9f3b-1fffcd3335a5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Getting quotas for project c036c284f0be4d2d8e070be841f52d9c. Resources: {'instances', 'ram', 'cores'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:35:23.755696 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-f14665a3-4ba0-446f-9f3b-1fffcd3335a5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Getting quotas for user 0e6127e7600b4ec9beae1e0ce6241f60 and project c036c284f0be4d2d8e070be841f52d9c. Resources: {'instances', 'ram', 'cores'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:35:23.768112 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f14665a3-4ba0-446f-9f3b-1fffcd3335a5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Going to run 1 instances... {{(pid=100592) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:35:23.771461 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f14665a3-4ba0-446f-9f3b-1fffcd3335a5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba8326d8-5d1b-42a2-a65e-f1108a025e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100592) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:35:23.834223 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f14665a3-4ba0-446f-9f3b-1fffcd3335a5 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.094320 Apr 20 18:35:23.835188 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 290/574] 10.222.0.25 () {60 vars in 1137 bytes} [Tue Apr 20 18:35:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:35:23.846977 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-afcf8ef8-b183-4b86-980e-9d9acdd82888 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:23.847830 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-afcf8ef8-b183-4b86-980e-9d9acdd82888 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:23.998312 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-afcf8ef8-b183-4b86-980e-9d9acdd82888 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:24.011615 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-afcf8ef8-b183-4b86-980e-9d9acdd82888 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 200 len: 1219 microversion: 2.1 time: 0.168895 Apr 20 18:35:24.013127 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 291/575] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:23 2021] GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 1219 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:24.075194 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b728e6f5-e72b-4af5-ba2e-e68e40ea0ba1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:24.093793 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b728e6f5-e72b-4af5-ba2e-e68e40ea0ba1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 200 len: 1513 microversion: 2.1 time: 0.520442 Apr 20 18:35:24.095042 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 285/576] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:23 2021] GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 1513 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:24.290442 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-cd399a3b-4daa-47c0-b81f-6226149d7fa7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:24.291137 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-cd399a3b-4daa-47c0-b81f-6226149d7fa7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:24.303351 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cd399a3b-4daa-47c0-b81f-6226149d7fa7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:24.304177 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cd399a3b-4daa-47c0-b81f-6226149d7fa7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:24.305450 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cd399a3b-4daa-47c0-b81f-6226149d7fa7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:24.306569 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cd399a3b-4daa-47c0-b81f-6226149d7fa7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:24.594055 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6f5a00b8-1f8e-45ab-9fbc-cf460f0cf689 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:24.595311 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6f5a00b8-1f8e-45ab-9fbc-cf460f0cf689 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:24.610783 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6f5a00b8-1f8e-45ab-9fbc-cf460f0cf689 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:24.611697 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6f5a00b8-1f8e-45ab-9fbc-cf460f0cf689 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:24.613226 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6f5a00b8-1f8e-45ab-9fbc-cf460f0cf689 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:24.614163 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6f5a00b8-1f8e-45ab-9fbc-cf460f0cf689 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:24.667166 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-cd399a3b-4daa-47c0-b81f-6226149d7fa7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:24.679769 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-cd399a3b-4daa-47c0-b81f-6226149d7fa7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:24.681614 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-cd399a3b-4daa-47c0-b81f-6226149d7fa7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:24.683004 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-cd399a3b-4daa-47c0-b81f-6226149d7fa7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1809 microversion: 2.20 time: 0.405124 Apr 20 18:35:24.684002 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 292/577] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:24 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1809 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:25.034950 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-22316f89-642a-4cd1-8ba5-6dffaf3f9ad0 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:25.037848 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-22316f89-642a-4cd1-8ba5-6dffaf3f9ad0 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:25.055357 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-22316f89-642a-4cd1-8ba5-6dffaf3f9ad0 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:25.056253 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-22316f89-642a-4cd1-8ba5-6dffaf3f9ad0 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:25.058155 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-22316f89-642a-4cd1-8ba5-6dffaf3f9ad0 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:25.059367 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-22316f89-642a-4cd1-8ba5-6dffaf3f9ad0 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:25.327027 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-22316f89-642a-4cd1-8ba5-6dffaf3f9ad0 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:25.338556 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-22316f89-642a-4cd1-8ba5-6dffaf3f9ad0 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 200 len: 1215 microversion: 2.1 time: 0.312207 Apr 20 18:35:25.340029 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 293/578] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:25 2021] GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 1215 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:35:25.351194 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6890a828-c10e-462f-b43e-32f6a7e0357c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:25.355072 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6890a828-c10e-462f-b43e-32f6a7e0357c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:25.365521 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6890a828-c10e-462f-b43e-32f6a7e0357c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:25.366015 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6890a828-c10e-462f-b43e-32f6a7e0357c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:25.367105 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6890a828-c10e-462f-b43e-32f6a7e0357c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:25.367783 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6890a828-c10e-462f-b43e-32f6a7e0357c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:25.622515 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6890a828-c10e-462f-b43e-32f6a7e0357c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:25.632560 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6890a828-c10e-462f-b43e-32f6a7e0357c tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 200 len: 1513 microversion: 2.1 time: 0.291057 Apr 20 18:35:25.633233 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 294/579] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:25 2021] GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 1513 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:25.688595 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6f5a00b8-1f8e-45ab-9fbc-cf460f0cf689 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:25.713900 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6f5a00b8-1f8e-45ab-9fbc-cf460f0cf689 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1554 microversion: 2.1 time: 1.127532 Apr 20 18:35:25.715125 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 286/580] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:24 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1554 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:25.728018 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c56ed607-22ef-4f57-af6c-0b02c1452339 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:25.728018 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c56ed607-22ef-4f57-af6c-0b02c1452339 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:25.731587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c56ed607-22ef-4f57-af6c-0b02c1452339 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:25.732110 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c56ed607-22ef-4f57-af6c-0b02c1452339 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:25.732993 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c56ed607-22ef-4f57-af6c-0b02c1452339 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:25.733551 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c56ed607-22ef-4f57-af6c-0b02c1452339 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:26.023203 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c56ed607-22ef-4f57-af6c-0b02c1452339 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:26.038144 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c56ed607-22ef-4f57-af6c-0b02c1452339 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:26.044460 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c56ed607-22ef-4f57-af6c-0b02c1452339 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:26.046216 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c56ed607-22ef-4f57-af6c-0b02c1452339 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1751 microversion: 2.20 time: 0.334376 Apr 20 18:35:26.047599 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 295/581] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:25 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1751 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:26.360932 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-40d1c19d-6563-4189-b1a7-ad28c301926f tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:26.362051 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-40d1c19d-6563-4189-b1a7-ad28c301926f tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:26.383755 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-40d1c19d-6563-4189-b1a7-ad28c301926f tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:26.385044 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-40d1c19d-6563-4189-b1a7-ad28c301926f tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:26.387113 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-40d1c19d-6563-4189-b1a7-ad28c301926f tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:26.388329 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-40d1c19d-6563-4189-b1a7-ad28c301926f tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:26.651158 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-44b0a2c5-b32b-4400-bc4b-9428bbbf6fca tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:26.652293 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-44b0a2c5-b32b-4400-bc4b-9428bbbf6fca tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:26.663778 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-44b0a2c5-b32b-4400-bc4b-9428bbbf6fca tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:26.665100 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-44b0a2c5-b32b-4400-bc4b-9428bbbf6fca tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:26.666865 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-44b0a2c5-b32b-4400-bc4b-9428bbbf6fca tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:26.668157 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-44b0a2c5-b32b-4400-bc4b-9428bbbf6fca tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:27.321201 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-40d1c19d-6563-4189-b1a7-ad28c301926f tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:27.332908 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-40d1c19d-6563-4189-b1a7-ad28c301926f tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 200 len: 1271 microversion: 2.1 time: 0.976773 Apr 20 18:35:27.345536 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 287/582] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:26 2021] GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 1271 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:35:27.361057 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6461b29e-1550-4013-b3ff-7a2361707dc6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:27.362164 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6461b29e-1550-4013-b3ff-7a2361707dc6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:27.394412 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6461b29e-1550-4013-b3ff-7a2361707dc6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:27.395104 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6461b29e-1550-4013-b3ff-7a2361707dc6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:27.396462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6461b29e-1550-4013-b3ff-7a2361707dc6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:27.397156 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6461b29e-1550-4013-b3ff-7a2361707dc6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:27.450313 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-44b0a2c5-b32b-4400-bc4b-9428bbbf6fca tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:27.467775 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-44b0a2c5-b32b-4400-bc4b-9428bbbf6fca tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 200 len: 1513 microversion: 2.1 time: 0.820584 Apr 20 18:35:27.469812 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 296/583] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:26 2021] GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 1513 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:27.480362 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e2b62365-bb6b-4e26-b98f-965ce47d4e76 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:27.488210 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e2b62365-bb6b-4e26-b98f-965ce47d4e76 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:27.516074 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e2b62365-bb6b-4e26-b98f-965ce47d4e76 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:27.516653 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e2b62365-bb6b-4e26-b98f-965ce47d4e76 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:27.517770 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e2b62365-bb6b-4e26-b98f-965ce47d4e76 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:27.518327 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e2b62365-bb6b-4e26-b98f-965ce47d4e76 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:28.363160 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6461b29e-1550-4013-b3ff-7a2361707dc6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:28.388250 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6461b29e-1550-4013-b3ff-7a2361707dc6 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1554 microversion: 2.1 time: 1.039172 Apr 20 18:35:28.399562 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 288/584] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:27 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1554 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:28.413660 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-467d5c6d-116f-4a32-b11a-6f4d0878985c req-862e39d0-7e46-41fd-a827-35c1fb72ae3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcbd1381-0624-4c44-8ad1-a058cf37eb89", "name": "network-vif-deleted", "tag": "4800bd55-987f-4f15-ad9f-8ef10a6a45b7"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:35:28.427832 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:35:28.427832 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:35:28.467093 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-467d5c6d-116f-4a32-b11a-6f4d0878985c req-862e39d0-7e46-41fd-a827-35c1fb72ae3e service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:28.473614 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-467d5c6d-116f-4a32-b11a-6f4d0878985c req-862e39d0-7e46-41fd-a827-35c1fb72ae3e service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:28.534208 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-467d5c6d-116f-4a32-b11a-6f4d0878985c req-862e39d0-7e46-41fd-a827-35c1fb72ae3e service nova] Creating event network-vif-deleted:4800bd55-987f-4f15-ad9f-8ef10a6a45b7 for instance dcbd1381-0624-4c44-8ad1-a058cf37eb89 on hv-cinder-78693 Apr 20 18:35:28.551602 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-467d5c6d-116f-4a32-b11a-6f4d0878985c req-862e39d0-7e46-41fd-a827-35c1fb72ae3e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150416 Apr 20 18:35:28.558619 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 289/585] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:35:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:35:28.571298 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ebfd0901-55f9-4f3a-a895-03141139b744 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:28.572078 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ebfd0901-55f9-4f3a-a895-03141139b744 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:28.594716 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ebfd0901-55f9-4f3a-a895-03141139b744 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:28.595642 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ebfd0901-55f9-4f3a-a895-03141139b744 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:28.596737 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ebfd0901-55f9-4f3a-a895-03141139b744 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:28.598634 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ebfd0901-55f9-4f3a-a895-03141139b744 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:28.644181 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e2b62365-bb6b-4e26-b98f-965ce47d4e76 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:28.703880 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e2b62365-bb6b-4e26-b98f-965ce47d4e76 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:28.720805 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e2b62365-bb6b-4e26-b98f-965ce47d4e76 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:28.723585 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e2b62365-bb6b-4e26-b98f-965ce47d4e76 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1751 microversion: 2.20 time: 1.250291 Apr 20 18:35:28.725309 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 297/586] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:27 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1751 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:28.748138 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a0cdb0d7-123f-4863-94bb-a006b4b1d03f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:28.749528 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a0cdb0d7-123f-4863-94bb-a006b4b1d03f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:28.766407 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a0cdb0d7-123f-4863-94bb-a006b4b1d03f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:28.767591 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a0cdb0d7-123f-4863-94bb-a006b4b1d03f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:28.769347 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a0cdb0d7-123f-4863-94bb-a006b4b1d03f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:28.770347 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a0cdb0d7-123f-4863-94bb-a006b4b1d03f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:28.851822 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ebfd0901-55f9-4f3a-a895-03141139b744 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:28.862406 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ebfd0901-55f9-4f3a-a895-03141139b744 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 200 len: 1277 microversion: 2.1 time: 0.302261 Apr 20 18:35:28.870574 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a0cdb0d7-123f-4863-94bb-a006b4b1d03f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:28.871093 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a0cdb0d7-123f-4863-94bb-a006b4b1d03f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:28.871631 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-a0cdb0d7-123f-4863-94bb-a006b4b1d03f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lazy-loading 'fault' on Instance uuid dcbd1381-0624-4c44-8ad1-a058cf37eb89 {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:35:28.876341 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 290/587] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:28 2021] GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 1277 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:29.117135 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a0cdb0d7-123f-4863-94bb-a006b4b1d03f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:29.135019 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a0cdb0d7-123f-4863-94bb-a006b4b1d03f tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 200 len: 1308 microversion: 2.1 time: 0.394308 Apr 20 18:35:29.136100 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 298/588] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:28 2021] GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 1308 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:29.406925 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-dd68c831-1d5f-40d9-b511-b6f0b418951f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:29.407788 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-dd68c831-1d5f-40d9-b511-b6f0b418951f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:29.432919 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dd68c831-1d5f-40d9-b511-b6f0b418951f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:29.433972 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dd68c831-1d5f-40d9-b511-b6f0b418951f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:29.435088 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dd68c831-1d5f-40d9-b511-b6f0b418951f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:29.435752 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dd68c831-1d5f-40d9-b511-b6f0b418951f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:29.749068 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-89d7e499-997d-4a69-bb8b-6905bb34cf37 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:29.750312 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-89d7e499-997d-4a69-bb8b-6905bb34cf37 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:29.763149 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-89d7e499-997d-4a69-bb8b-6905bb34cf37 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:29.764025 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-89d7e499-997d-4a69-bb8b-6905bb34cf37 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:29.765453 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-89d7e499-997d-4a69-bb8b-6905bb34cf37 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:29.766310 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-89d7e499-997d-4a69-bb8b-6905bb34cf37 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:29.956019 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-dd68c831-1d5f-40d9-b511-b6f0b418951f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:29.977948 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-dd68c831-1d5f-40d9-b511-b6f0b418951f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1560 microversion: 2.1 time: 0.574250 Apr 20 18:35:29.979348 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 291/589] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:29 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1560 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:29.990186 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-29e69c58-9bf8-4f5a-b9da-16dd03f79651 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:29.991648 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-29e69c58-9bf8-4f5a-b9da-16dd03f79651 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:30.029731 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29e69c58-9bf8-4f5a-b9da-16dd03f79651 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:30.042324 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29e69c58-9bf8-4f5a-b9da-16dd03f79651 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:30.044456 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29e69c58-9bf8-4f5a-b9da-16dd03f79651 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:30.047892 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29e69c58-9bf8-4f5a-b9da-16dd03f79651 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:30.532351 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-29e69c58-9bf8-4f5a-b9da-16dd03f79651 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:30.552396 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-29e69c58-9bf8-4f5a-b9da-16dd03f79651 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 200 len: 1319 microversion: 2.1 time: 0.570417 Apr 20 18:35:30.554403 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 292/590] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:29 2021] GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 1319 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:30.560551 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6ee8dc7b-b12a-43eb-9b01-fceed96330de tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:30.561600 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6ee8dc7b-b12a-43eb-9b01-fceed96330de tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: dcbd1381-0624-4c44-8ad1-a058cf37eb89] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:30.572634 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6ee8dc7b-b12a-43eb-9b01-fceed96330de tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:30.573323 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6ee8dc7b-b12a-43eb-9b01-fceed96330de tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:30.575286 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6ee8dc7b-b12a-43eb-9b01-fceed96330de tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:30.576076 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6ee8dc7b-b12a-43eb-9b01-fceed96330de tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:30.653973 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-6ee8dc7b-b12a-43eb-9b01-fceed96330de tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] HTTP exception thrown: Instance dcbd1381-0624-4c44-8ad1-a058cf37eb89 could not be found. Apr 20 18:35:30.655575 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6ee8dc7b-b12a-43eb-9b01-fceed96330de tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Returning 404 to user: Instance dcbd1381-0624-4c44-8ad1-a058cf37eb89 could not be found. {{(pid=100593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:35:30.657642 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6ee8dc7b-b12a-43eb-9b01-fceed96330de tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89" status: 404 len: 111 microversion: 2.1 time: 0.100955 Apr 20 18:35:30.660448 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 293/591] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:30 2021] GET /compute/v2.1/servers/dcbd1381-0624-4c44-8ad1-a058cf37eb89 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:35:30.671263 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8969b99b-9e08-4fc6-b6c8-151d40da5250 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:30.672568 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8969b99b-9e08-4fc6-b6c8-151d40da5250 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:30.691823 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8969b99b-9e08-4fc6-b6c8-151d40da5250 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:30.693700 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8969b99b-9e08-4fc6-b6c8-151d40da5250 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:30.695994 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8969b99b-9e08-4fc6-b6c8-151d40da5250 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:30.697311 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8969b99b-9e08-4fc6-b6c8-151d40da5250 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:30.745729 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-89d7e499-997d-4a69-bb8b-6905bb34cf37 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:30.791891 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-89d7e499-997d-4a69-bb8b-6905bb34cf37 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:30.795324 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-89d7e499-997d-4a69-bb8b-6905bb34cf37 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:30.797527 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-89d7e499-997d-4a69-bb8b-6905bb34cf37 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1751 microversion: 2.20 time: 1.055039 Apr 20 18:35:30.798897 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 299/592] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:29 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1751 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:35:30.832032 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-854756e6-e8d5-4a63-b29d-1d9df9d0a81b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:30.833120 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-854756e6-e8d5-4a63-b29d-1d9df9d0a81b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:30.849630 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-854756e6-e8d5-4a63-b29d-1d9df9d0a81b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:30.850591 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-854756e6-e8d5-4a63-b29d-1d9df9d0a81b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:30.852176 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-854756e6-e8d5-4a63-b29d-1d9df9d0a81b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:30.852927 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-854756e6-e8d5-4a63-b29d-1d9df9d0a81b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:31.006944 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-854756e6-e8d5-4a63-b29d-1d9df9d0a81b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Going to try to terminate instance {{(pid=100592) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:35:31.115271 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-8969b99b-9e08-4fc6-b6c8-151d40da5250 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lazy-loading 'services' on Instance uuid aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d {{(pid=100593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:35:31.306229 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-854756e6-e8d5-4a63-b29d-1d9df9d0a81b tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "DELETE /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a" status: 204 len: 0 microversion: 2.1 time: 0.490230 Apr 20 18:35:31.307256 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 300/593] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:35:30 2021] DELETE /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:35:31.321315 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d23c1c2c-af40-4ccc-b51a-fbe1fc94ac51 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:31.323017 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d23c1c2c-af40-4ccc-b51a-fbe1fc94ac51 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:31.344774 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d23c1c2c-af40-4ccc-b51a-fbe1fc94ac51 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:31.345325 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d23c1c2c-af40-4ccc-b51a-fbe1fc94ac51 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:31.346315 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d23c1c2c-af40-4ccc-b51a-fbe1fc94ac51 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:31.347463 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d23c1c2c-af40-4ccc-b51a-fbe1fc94ac51 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:31.433850 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8969b99b-9e08-4fc6-b6c8-151d40da5250 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d/os-volume_attachments/4073df06-b328-47bf-8ee8-0052772e4934" status: 202 len: 0 microversion: 2.1 time: 0.766683 Apr 20 18:35:31.435201 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 294/594] 10.222.0.25 () {58 vars in 1406 bytes} [Tue Apr 20 18:35:30 2021] DELETE /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d/os-volume_attachments/4073df06-b328-47bf-8ee8-0052772e4934 => generated 0 bytes in 774 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:35:31.573720 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-36a1388c-a788-412e-8cda-2773eeccb30b tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:31.595176 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-36a1388c-a788-412e-8cda-2773eeccb30b tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:31.627615 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-36a1388c-a788-412e-8cda-2773eeccb30b tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:31.631304 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-36a1388c-a788-412e-8cda-2773eeccb30b tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:31.634225 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-36a1388c-a788-412e-8cda-2773eeccb30b tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:31.635029 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-36a1388c-a788-412e-8cda-2773eeccb30b tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:32.110584 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-36a1388c-a788-412e-8cda-2773eeccb30b tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:32.128170 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-36a1388c-a788-412e-8cda-2773eeccb30b tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 200 len: 1319 microversion: 2.1 time: 0.560765 Apr 20 18:35:32.130223 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 295/595] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:31 2021] GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 1319 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:32.137889 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-775e18e8-1bb2-4549-99c6-59c0d6480b67 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:32.138729 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-775e18e8-1bb2-4549-99c6-59c0d6480b67 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:32.155729 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-775e18e8-1bb2-4549-99c6-59c0d6480b67 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:32.156242 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-775e18e8-1bb2-4549-99c6-59c0d6480b67 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:32.157112 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-775e18e8-1bb2-4549-99c6-59c0d6480b67 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:32.157639 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-775e18e8-1bb2-4549-99c6-59c0d6480b67 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:32.563527 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d23c1c2c-af40-4ccc-b51a-fbe1fc94ac51 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:32.601152 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d23c1c2c-af40-4ccc-b51a-fbe1fc94ac51 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a" status: 200 len: 1512 microversion: 2.1 time: 1.288342 Apr 20 18:35:32.609230 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 301/596] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:31 2021] GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a => generated 1512 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:32.760679 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-775e18e8-1bb2-4549-99c6-59c0d6480b67 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:32.784095 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-775e18e8-1bb2-4549-99c6-59c0d6480b67 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:32.793701 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-775e18e8-1bb2-4549-99c6-59c0d6480b67 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:32.796464 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-775e18e8-1bb2-4549-99c6-59c0d6480b67 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.664451 Apr 20 18:35:32.804993 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 296/597] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:32 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:33.155002 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7bb3595d-6ff0-46bf-8e38-5a4b7c5c9bd0 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:33.156146 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7bb3595d-6ff0-46bf-8e38-5a4b7c5c9bd0 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:33.197793 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7bb3595d-6ff0-46bf-8e38-5a4b7c5c9bd0 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:33.204666 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7bb3595d-6ff0-46bf-8e38-5a4b7c5c9bd0 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:33.206401 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7bb3595d-6ff0-46bf-8e38-5a4b7c5c9bd0 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:33.207330 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7bb3595d-6ff0-46bf-8e38-5a4b7c5c9bd0 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:33.642158 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2948f36e-b4cc-4e11-9e5b-b1317be7d607 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:33.643105 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2948f36e-b4cc-4e11-9e5b-b1317be7d607 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:33.680625 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2948f36e-b4cc-4e11-9e5b-b1317be7d607 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:33.684656 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2948f36e-b4cc-4e11-9e5b-b1317be7d607 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:33.699786 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2948f36e-b4cc-4e11-9e5b-b1317be7d607 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:33.702363 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2948f36e-b4cc-4e11-9e5b-b1317be7d607 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:35.135573 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2948f36e-b4cc-4e11-9e5b-b1317be7d607 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:35.174506 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2948f36e-b4cc-4e11-9e5b-b1317be7d607 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a" status: 200 len: 1512 microversion: 2.1 time: 1.536861 Apr 20 18:35:35.176098 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 297/598] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:33 2021] GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a => generated 1512 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:35:35.210430 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-feb02c02-1f3a-456c-8c5a-5e33466a9c44 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:35.214995 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-feb02c02-1f3a-456c-8c5a-5e33466a9c44 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:35.236371 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-feb02c02-1f3a-456c-8c5a-5e33466a9c44 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:35.238813 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-feb02c02-1f3a-456c-8c5a-5e33466a9c44 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:35.242158 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-feb02c02-1f3a-456c-8c5a-5e33466a9c44 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:35.243944 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-feb02c02-1f3a-456c-8c5a-5e33466a9c44 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:35.892369 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-feb02c02-1f3a-456c-8c5a-5e33466a9c44 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:35.926539 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-feb02c02-1f3a-456c-8c5a-5e33466a9c44 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:35.933278 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-feb02c02-1f3a-456c-8c5a-5e33466a9c44 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:35.936741 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-feb02c02-1f3a-456c-8c5a-5e33466a9c44 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.742024 Apr 20 18:35:35.938706 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 298/599] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:35 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:35.990587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-3fd06844-23e2-460f-b638-904e68fb2b9f req-5b665503-319b-4c26-b22e-2a29bffd7341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "297d64ba-9465-41f0-8806-f19d3ad6b716", "tag": "72140066-865c-41ce-87d7-1a043a14cb33"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:35:35.996784 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:35:35.996784 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:35:36.022526 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-3fd06844-23e2-460f-b638-904e68fb2b9f req-5b665503-319b-4c26-b22e-2a29bffd7341 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:36.023965 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-3fd06844-23e2-460f-b638-904e68fb2b9f req-5b665503-319b-4c26-b22e-2a29bffd7341 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:36.075162 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-3fd06844-23e2-460f-b638-904e68fb2b9f req-5b665503-319b-4c26-b22e-2a29bffd7341 service nova] Creating event network-changed:72140066-865c-41ce-87d7-1a043a14cb33 for instance 297d64ba-9465-41f0-8806-f19d3ad6b716 on hv-cinder-78693 Apr 20 18:35:36.088784 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-3fd06844-23e2-460f-b638-904e68fb2b9f req-5b665503-319b-4c26-b22e-2a29bffd7341 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119156 Apr 20 18:35:36.090523 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 299/600] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:35:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:35:36.213361 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d860dad1-e102-4dc9-86ea-6e8a73b293a3 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:36.214593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d860dad1-e102-4dc9-86ea-6e8a73b293a3 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:36.237661 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7bb3595d-6ff0-46bf-8e38-5a4b7c5c9bd0 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:36.247703 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d860dad1-e102-4dc9-86ea-6e8a73b293a3 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:36.248560 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d860dad1-e102-4dc9-86ea-6e8a73b293a3 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:36.249641 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d860dad1-e102-4dc9-86ea-6e8a73b293a3 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:36.250474 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d860dad1-e102-4dc9-86ea-6e8a73b293a3 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:36.274187 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7bb3595d-6ff0-46bf-8e38-5a4b7c5c9bd0 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 200 len: 1319 microversion: 2.1 time: 3.127029 Apr 20 18:35:36.288974 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 302/601] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:33 2021] GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 1319 bytes in 3144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:36.955061 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d860dad1-e102-4dc9-86ea-6e8a73b293a3 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:37.018220 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a2ace485-42cf-4e3a-bc06-c27bd60281a1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:37.020012 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d860dad1-e102-4dc9-86ea-6e8a73b293a3 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a" status: 200 len: 1512 microversion: 2.1 time: 0.813031 Apr 20 18:35:37.021987 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a2ace485-42cf-4e3a-bc06-c27bd60281a1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:37.022501 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 300/602] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:36 2021] GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a => generated 1512 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:35:37.066343 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a2ace485-42cf-4e3a-bc06-c27bd60281a1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:37.075912 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a2ace485-42cf-4e3a-bc06-c27bd60281a1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:37.079912 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a2ace485-42cf-4e3a-bc06-c27bd60281a1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:37.096181 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a2ace485-42cf-4e3a-bc06-c27bd60281a1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:37.314672 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1b480299-74f2-4de8-8571-de925ce8ccb1 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:37.315521 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1b480299-74f2-4de8-8571-de925ce8ccb1 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:37.339161 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1b480299-74f2-4de8-8571-de925ce8ccb1 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:37.339675 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1b480299-74f2-4de8-8571-de925ce8ccb1 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:37.340753 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1b480299-74f2-4de8-8571-de925ce8ccb1 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:37.341038 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1b480299-74f2-4de8-8571-de925ce8ccb1 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:37.890120 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1b480299-74f2-4de8-8571-de925ce8ccb1 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:37.906632 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1b480299-74f2-4de8-8571-de925ce8ccb1 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 200 len: 1319 microversion: 2.1 time: 0.600183 Apr 20 18:35:37.917958 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 301/603] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:37 2021] GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 1319 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:38.056677 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8ac9409f-9a6b-46ac-919e-a7ba1ce791b7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:38.057829 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8ac9409f-9a6b-46ac-919e-a7ba1ce791b7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:38.080242 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8ac9409f-9a6b-46ac-919e-a7ba1ce791b7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:38.081221 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8ac9409f-9a6b-46ac-919e-a7ba1ce791b7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:38.082637 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8ac9409f-9a6b-46ac-919e-a7ba1ce791b7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:38.083903 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8ac9409f-9a6b-46ac-919e-a7ba1ce791b7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:38.454825 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8ac9409f-9a6b-46ac-919e-a7ba1ce791b7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:38.518796 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8ac9409f-9a6b-46ac-919e-a7ba1ce791b7 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a" status: 200 len: 1470 microversion: 2.1 time: 0.465852 Apr 20 18:35:38.549593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 302/604] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:38 2021] GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a => generated 1470 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:38.585931 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a2ace485-42cf-4e3a-bc06-c27bd60281a1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:38.603845 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d549d49a-2193-49e9-8b92-7a8b4aae0f1a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:38.604851 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d549d49a-2193-49e9-8b92-7a8b4aae0f1a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:38.612676 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a2ace485-42cf-4e3a-bc06-c27bd60281a1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:38.619430 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a2ace485-42cf-4e3a-bc06-c27bd60281a1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:38.625880 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a2ace485-42cf-4e3a-bc06-c27bd60281a1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 1.634801 Apr 20 18:35:38.630266 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 303/605] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:36 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:35:38.641030 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d549d49a-2193-49e9-8b92-7a8b4aae0f1a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:38.642322 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-551c659e-17ce-4865-bf4a-c7ada3e9536b req-37b8486d-1ff4-4961-b2bb-6608a18a15eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d31bbe-375e-4999-b7ac-a82a2117c84a", "name": "network-vif-deleted", "tag": "5744b43c-bc61-4a13-be0f-42c722995478"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:35:38.653469 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d549d49a-2193-49e9-8b92-7a8b4aae0f1a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:38.655202 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:35:38.655202 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:35:38.655692 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d549d49a-2193-49e9-8b92-7a8b4aae0f1a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:38.656887 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d549d49a-2193-49e9-8b92-7a8b4aae0f1a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:38.692841 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-551c659e-17ce-4865-bf4a-c7ada3e9536b req-37b8486d-1ff4-4961-b2bb-6608a18a15eb service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:38.693687 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-551c659e-17ce-4865-bf4a-c7ada3e9536b req-37b8486d-1ff4-4961-b2bb-6608a18a15eb service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:38.772625 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-551c659e-17ce-4865-bf4a-c7ada3e9536b req-37b8486d-1ff4-4961-b2bb-6608a18a15eb service nova] Creating event network-vif-deleted:5744b43c-bc61-4a13-be0f-42c722995478 for instance 98d31bbe-375e-4999-b7ac-a82a2117c84a on hv-cinder-78693 Apr 20 18:35:38.794227 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-551c659e-17ce-4865-bf4a-c7ada3e9536b req-37b8486d-1ff4-4961-b2bb-6608a18a15eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162055 Apr 20 18:35:38.796447 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 304/606] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:35:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:35:38.929541 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-555944c3-5c19-4d37-b277-6e90b6b15475 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:38.930941 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-555944c3-5c19-4d37-b277-6e90b6b15475 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:38.956503 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-555944c3-5c19-4d37-b277-6e90b6b15475 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:38.962794 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-555944c3-5c19-4d37-b277-6e90b6b15475 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:38.964560 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-555944c3-5c19-4d37-b277-6e90b6b15475 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:38.965969 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-555944c3-5c19-4d37-b277-6e90b6b15475 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:39.006536 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d549d49a-2193-49e9-8b92-7a8b4aae0f1a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Going to try to terminate instance {{(pid=100593) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:35:39.337466 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d549d49a-2193-49e9-8b92-7a8b4aae0f1a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 204 len: 0 microversion: 2.1 time: 0.741392 Apr 20 18:35:39.338320 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 303/607] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:35:38 2021] DELETE /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:35:39.349950 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-be4db845-adc2-4358-ac33-ab2d4a2f17bb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:39.350752 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-be4db845-adc2-4358-ac33-ab2d4a2f17bb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:39.359597 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-be4db845-adc2-4358-ac33-ab2d4a2f17bb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:39.360117 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-be4db845-adc2-4358-ac33-ab2d4a2f17bb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:39.360992 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-be4db845-adc2-4358-ac33-ab2d4a2f17bb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:39.361526 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-be4db845-adc2-4358-ac33-ab2d4a2f17bb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:39.789524 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-555944c3-5c19-4d37-b277-6e90b6b15475 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:39.829616 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-555944c3-5c19-4d37-b277-6e90b6b15475 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 200 len: 1319 microversion: 2.1 time: 0.906893 Apr 20 18:35:39.834801 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 305/608] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:38 2021] GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 1319 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:39.877727 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e3afb98c-5fbe-4be2-aa4e-78f7bccc1aae tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:39.879392 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e3afb98c-5fbe-4be2-aa4e-78f7bccc1aae tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:39.922289 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e3afb98c-5fbe-4be2-aa4e-78f7bccc1aae tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:39.923334 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e3afb98c-5fbe-4be2-aa4e-78f7bccc1aae tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:39.925097 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e3afb98c-5fbe-4be2-aa4e-78f7bccc1aae tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:39.926210 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e3afb98c-5fbe-4be2-aa4e-78f7bccc1aae tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:39.932549 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-be4db845-adc2-4358-ac33-ab2d4a2f17bb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:39.946457 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-be4db845-adc2-4358-ac33-ab2d4a2f17bb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1506 microversion: 2.1 time: 0.601384 Apr 20 18:35:39.947392 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 304/609] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:39 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1506 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:39.952712 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-bd7af480-b0d1-4b10-b953-05ab406c303c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:39.953752 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-bd7af480-b0d1-4b10-b953-05ab406c303c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:39.970799 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bd7af480-b0d1-4b10-b953-05ab406c303c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:39.971958 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bd7af480-b0d1-4b10-b953-05ab406c303c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:39.973672 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bd7af480-b0d1-4b10-b953-05ab406c303c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:39.974385 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bd7af480-b0d1-4b10-b953-05ab406c303c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:40.218088 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e3afb98c-5fbe-4be2-aa4e-78f7bccc1aae tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:40.219153 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e3afb98c-5fbe-4be2-aa4e-78f7bccc1aae tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:40.220670 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-e3afb98c-5fbe-4be2-aa4e-78f7bccc1aae tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lazy-loading 'fault' on Instance uuid 98d31bbe-375e-4999-b7ac-a82a2117c84a {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:35:40.434491 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-bd7af480-b0d1-4b10-b953-05ab406c303c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:40.447050 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-bd7af480-b0d1-4b10-b953-05ab406c303c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:40.448797 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-bd7af480-b0d1-4b10-b953-05ab406c303c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:40.457483 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-bd7af480-b0d1-4b10-b953-05ab406c303c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.508412 Apr 20 18:35:40.460463 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 305/610] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:39 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:40.523287 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e3afb98c-5fbe-4be2-aa4e-78f7bccc1aae tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:40.551135 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e3afb98c-5fbe-4be2-aa4e-78f7bccc1aae tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a" status: 200 len: 1307 microversion: 2.1 time: 0.698606 Apr 20 18:35:40.558756 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 306/611] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:39 2021] GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a => generated 1307 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:40.866286 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-953d6de3-6d04-4c00-800a-05c0ddae38a7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:40.867627 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-953d6de3-6d04-4c00-800a-05c0ddae38a7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:40.883403 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-953d6de3-6d04-4c00-800a-05c0ddae38a7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:40.886628 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-953d6de3-6d04-4c00-800a-05c0ddae38a7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:40.889234 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-953d6de3-6d04-4c00-800a-05c0ddae38a7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:40.891922 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-953d6de3-6d04-4c00-800a-05c0ddae38a7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:40.986307 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4ae91745-d257-45f3-9431-372c39133da5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:40.987949 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4ae91745-d257-45f3-9431-372c39133da5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:41.010017 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4ae91745-d257-45f3-9431-372c39133da5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:41.010935 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4ae91745-d257-45f3-9431-372c39133da5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:41.012491 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4ae91745-d257-45f3-9431-372c39133da5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:41.013802 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4ae91745-d257-45f3-9431-372c39133da5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:41.342214 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-953d6de3-6d04-4c00-800a-05c0ddae38a7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:41.352604 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-953d6de3-6d04-4c00-800a-05c0ddae38a7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 200 len: 1319 microversion: 2.1 time: 0.490786 Apr 20 18:35:41.353295 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 306/612] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:40 2021] GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 1319 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:41.518388 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-138eb76c-21e7-4a85-b089-b31aedb0c602 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:41.518388 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-138eb76c-21e7-4a85-b089-b31aedb0c602 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:41.574276 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-138eb76c-21e7-4a85-b089-b31aedb0c602 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:41.574276 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-138eb76c-21e7-4a85-b089-b31aedb0c602 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:41.574276 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-138eb76c-21e7-4a85-b089-b31aedb0c602 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:41.574276 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-138eb76c-21e7-4a85-b089-b31aedb0c602 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:41.657761 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4ae91745-d257-45f3-9431-372c39133da5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:41.731932 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4ae91745-d257-45f3-9431-372c39133da5 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1506 microversion: 2.1 time: 0.743584 Apr 20 18:35:41.743272 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 307/613] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:40 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1506 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:41.793602 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9f8f6697-c17e-48ff-a6a7-342b2d918ce2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:41.797371 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9f8f6697-c17e-48ff-a6a7-342b2d918ce2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 98d31bbe-375e-4999-b7ac-a82a2117c84a] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:41.836488 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9f8f6697-c17e-48ff-a6a7-342b2d918ce2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:41.840849 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9f8f6697-c17e-48ff-a6a7-342b2d918ce2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:41.842972 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9f8f6697-c17e-48ff-a6a7-342b2d918ce2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:41.851069 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9f8f6697-c17e-48ff-a6a7-342b2d918ce2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:42.093971 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-9f8f6697-c17e-48ff-a6a7-342b2d918ce2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] HTTP exception thrown: Instance 98d31bbe-375e-4999-b7ac-a82a2117c84a could not be found. Apr 20 18:35:42.100576 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9f8f6697-c17e-48ff-a6a7-342b2d918ce2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Returning 404 to user: Instance 98d31bbe-375e-4999-b7ac-a82a2117c84a could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:35:42.108884 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9f8f6697-c17e-48ff-a6a7-342b2d918ce2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a" status: 404 len: 111 microversion: 2.1 time: 0.360260 Apr 20 18:35:42.110705 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 308/614] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:41 2021] GET /compute/v2.1/servers/98d31bbe-375e-4999-b7ac-a82a2117c84a => generated 111 bytes in 367 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:35:42.344830 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-138eb76c-21e7-4a85-b089-b31aedb0c602 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:42.394763 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-52848754-8d83-4034-955e-19b5f58f6790 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:42.400365 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-138eb76c-21e7-4a85-b089-b31aedb0c602 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:42.402254 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-52848754-8d83-4034-955e-19b5f58f6790 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:42.410456 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-138eb76c-21e7-4a85-b089-b31aedb0c602 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:42.418812 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-52848754-8d83-4034-955e-19b5f58f6790 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:42.420184 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-52848754-8d83-4034-955e-19b5f58f6790 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:42.422046 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-52848754-8d83-4034-955e-19b5f58f6790 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:42.423085 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-52848754-8d83-4034-955e-19b5f58f6790 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:42.438658 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-138eb76c-21e7-4a85-b089-b31aedb0c602 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.949577 Apr 20 18:35:42.444899 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 307/615] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:41 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:42.805885 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1c96ac87-748c-4cae-b07a-b567ce2903ab tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:42.806882 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1c96ac87-748c-4cae-b07a-b567ce2903ab tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:42.830929 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1c96ac87-748c-4cae-b07a-b567ce2903ab tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:42.834045 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1c96ac87-748c-4cae-b07a-b567ce2903ab tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:42.836117 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1c96ac87-748c-4cae-b07a-b567ce2903ab tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:42.837256 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1c96ac87-748c-4cae-b07a-b567ce2903ab tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:42.927038 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-52848754-8d83-4034-955e-19b5f58f6790 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:42.950881 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-52848754-8d83-4034-955e-19b5f58f6790 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 200 len: 1319 microversion: 2.1 time: 0.566972 Apr 20 18:35:42.951975 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 309/616] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:42 2021] GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 1319 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:43.274334 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1c96ac87-748c-4cae-b07a-b567ce2903ab tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:43.296933 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1c96ac87-748c-4cae-b07a-b567ce2903ab tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1506 microversion: 2.1 time: 0.495101 Apr 20 18:35:43.298890 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 308/617] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:42 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1506 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:35:43.461242 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-dea39dbb-82a3-4294-90dc-fb31bd120a20 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:43.464482 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-dea39dbb-82a3-4294-90dc-fb31bd120a20 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:43.473682 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dea39dbb-82a3-4294-90dc-fb31bd120a20 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:43.474201 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dea39dbb-82a3-4294-90dc-fb31bd120a20 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:43.475231 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dea39dbb-82a3-4294-90dc-fb31bd120a20 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:43.475814 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dea39dbb-82a3-4294-90dc-fb31bd120a20 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:43.714481 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f34e5685-38e1-4494-b9a8-82e20d73a855 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:43.714991 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f34e5685-38e1-4494-b9a8-82e20d73a855 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:43.741969 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f34e5685-38e1-4494-b9a8-82e20d73a855 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:43.742557 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f34e5685-38e1-4494-b9a8-82e20d73a855 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:43.744002 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f34e5685-38e1-4494-b9a8-82e20d73a855 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:43.744877 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f34e5685-38e1-4494-b9a8-82e20d73a855 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:43.864476 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f34e5685-38e1-4494-b9a8-82e20d73a855 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Going to try to terminate instance {{(pid=100593) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:35:44.179778 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f34e5685-38e1-4494-b9a8-82e20d73a855 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 204 len: 0 microversion: 2.1 time: 0.469579 Apr 20 18:35:44.180751 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 309/618] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:35:43 2021] DELETE /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:35:44.193201 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-dea39dbb-82a3-4294-90dc-fb31bd120a20 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:44.193554 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2cefc187-17e0-4533-97de-1e5b16347a46 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:44.194298 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2cefc187-17e0-4533-97de-1e5b16347a46 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:44.215183 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2cefc187-17e0-4533-97de-1e5b16347a46 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:44.215888 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2cefc187-17e0-4533-97de-1e5b16347a46 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:44.216611 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2cefc187-17e0-4533-97de-1e5b16347a46 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:44.217113 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2cefc187-17e0-4533-97de-1e5b16347a46 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:44.219417 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-dea39dbb-82a3-4294-90dc-fb31bd120a20 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:44.221156 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-dea39dbb-82a3-4294-90dc-fb31bd120a20 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:44.222487 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-dea39dbb-82a3-4294-90dc-fb31bd120a20 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.766483 Apr 20 18:35:44.234191 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 310/619] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:43 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:44.241031 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7015e6be-4634-43f9-bb80-2286cd47b69d tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:44.241745 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7015e6be-4634-43f9-bb80-2286cd47b69d tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:44.262269 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7015e6be-4634-43f9-bb80-2286cd47b69d tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:44.263021 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7015e6be-4634-43f9-bb80-2286cd47b69d tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:44.263913 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7015e6be-4634-43f9-bb80-2286cd47b69d tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:44.267828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7015e6be-4634-43f9-bb80-2286cd47b69d tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:44.742352 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2cefc187-17e0-4533-97de-1e5b16347a46 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:44.754094 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2cefc187-17e0-4533-97de-1e5b16347a46 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 200 len: 1319 microversion: 2.1 time: 0.571622 Apr 20 18:35:44.754711 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 310/620] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:44 2021] GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 1319 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:44.778023 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c014071b-9fb0-41ad-b40b-3392cbc51f8e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:44.778832 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c014071b-9fb0-41ad-b40b-3392cbc51f8e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:44.807275 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c014071b-9fb0-41ad-b40b-3392cbc51f8e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:44.807794 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c014071b-9fb0-41ad-b40b-3392cbc51f8e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:44.809719 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c014071b-9fb0-41ad-b40b-3392cbc51f8e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:44.812760 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c014071b-9fb0-41ad-b40b-3392cbc51f8e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:45.105515 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7015e6be-4634-43f9-bb80-2286cd47b69d tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:45.124949 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7015e6be-4634-43f9-bb80-2286cd47b69d tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 200 len: 1514 microversion: 2.1 time: 0.887128 Apr 20 18:35:45.124949 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 311/621] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:44 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 1514 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:45.248033 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b113c8b7-1bd9-4219-8fda-a9628e0ec461 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:45.248705 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b113c8b7-1bd9-4219-8fda-a9628e0ec461 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:45.266589 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b113c8b7-1bd9-4219-8fda-a9628e0ec461 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:45.267110 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b113c8b7-1bd9-4219-8fda-a9628e0ec461 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:45.268013 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b113c8b7-1bd9-4219-8fda-a9628e0ec461 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:45.268540 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b113c8b7-1bd9-4219-8fda-a9628e0ec461 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:45.458218 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c014071b-9fb0-41ad-b40b-3392cbc51f8e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:45.469497 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c014071b-9fb0-41ad-b40b-3392cbc51f8e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1506 microversion: 2.1 time: 0.713552 Apr 20 18:35:45.485727 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 311/622] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:44 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1506 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:45.499544 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-d759a682-d08e-4211-88aa-b74147e11643 req-fca5b083-b180-49ae-8985-6d1ef360b6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "297d64ba-9465-41f0-8806-f19d3ad6b716", "name": "network-vif-plugged", "status": "completed", "tag": "72140066-865c-41ce-87d7-1a043a14cb33"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:35:45.501430 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:35:45.501430 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:35:45.545000 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-d759a682-d08e-4211-88aa-b74147e11643 req-fca5b083-b180-49ae-8985-6d1ef360b6c1 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:45.545000 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-d759a682-d08e-4211-88aa-b74147e11643 req-fca5b083-b180-49ae-8985-6d1ef360b6c1 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:45.570715 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-d759a682-d08e-4211-88aa-b74147e11643 req-fca5b083-b180-49ae-8985-6d1ef360b6c1 service nova] Creating event network-vif-plugged:72140066-865c-41ce-87d7-1a043a14cb33 for instance 297d64ba-9465-41f0-8806-f19d3ad6b716 on hv-cinder-78693 Apr 20 18:35:45.590870 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-d759a682-d08e-4211-88aa-b74147e11643 req-fca5b083-b180-49ae-8985-6d1ef360b6c1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105686 Apr 20 18:35:45.592516 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 312/623] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:35:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:35:45.808031 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-082e02eb-9d79-4031-964f-a4dc77d7114e tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:45.808031 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-082e02eb-9d79-4031-964f-a4dc77d7114e tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:45.847461 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-082e02eb-9d79-4031-964f-a4dc77d7114e tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:45.847970 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-082e02eb-9d79-4031-964f-a4dc77d7114e tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:45.854840 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-082e02eb-9d79-4031-964f-a4dc77d7114e tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:45.855477 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-082e02eb-9d79-4031-964f-a4dc77d7114e tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:45.965830 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b113c8b7-1bd9-4219-8fda-a9628e0ec461 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:46.017261 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b113c8b7-1bd9-4219-8fda-a9628e0ec461 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:46.025267 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b113c8b7-1bd9-4219-8fda-a9628e0ec461 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:46.030974 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b113c8b7-1bd9-4219-8fda-a9628e0ec461 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.787058 Apr 20 18:35:46.054195 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 312/624] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:45 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:35:46.141684 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-59d74925-dd52-4e70-ae2f-ff38a1ef76e2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:46.142335 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-59d74925-dd52-4e70-ae2f-ff38a1ef76e2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:46.166657 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-59d74925-dd52-4e70-ae2f-ff38a1ef76e2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:46.167288 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-59d74925-dd52-4e70-ae2f-ff38a1ef76e2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:46.172745 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-59d74925-dd52-4e70-ae2f-ff38a1ef76e2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:46.173441 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-59d74925-dd52-4e70-ae2f-ff38a1ef76e2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:46.424562 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-082e02eb-9d79-4031-964f-a4dc77d7114e tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:46.440051 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-082e02eb-9d79-4031-964f-a4dc77d7114e tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 200 len: 1319 microversion: 2.1 time: 0.665735 Apr 20 18:35:46.440744 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 313/625] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:45 2021] GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 1319 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:46.515322 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9338e664-0a3b-4dba-922d-0a89c21ced57 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:46.522789 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9338e664-0a3b-4dba-922d-0a89c21ced57 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:46.542711 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9338e664-0a3b-4dba-922d-0a89c21ced57 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:46.543309 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9338e664-0a3b-4dba-922d-0a89c21ced57 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:46.544835 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9338e664-0a3b-4dba-922d-0a89c21ced57 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:46.545347 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9338e664-0a3b-4dba-922d-0a89c21ced57 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:46.820209 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9338e664-0a3b-4dba-922d-0a89c21ced57 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:46.831343 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9338e664-0a3b-4dba-922d-0a89c21ced57 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1506 microversion: 2.1 time: 0.324886 Apr 20 18:35:46.832384 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 314/626] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:46 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1506 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:46.978533 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-59d74925-dd52-4e70-ae2f-ff38a1ef76e2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:46.995589 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-59d74925-dd52-4e70-ae2f-ff38a1ef76e2 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 200 len: 1514 microversion: 2.1 time: 0.858152 Apr 20 18:35:47.008768 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 313/627] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:46 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 1514 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:47.069649 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-13943bd0-0a3d-454d-812d-2d34973d0b08 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:47.070621 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-13943bd0-0a3d-454d-812d-2d34973d0b08 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:47.083571 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-13943bd0-0a3d-454d-812d-2d34973d0b08 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:47.084116 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-13943bd0-0a3d-454d-812d-2d34973d0b08 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:47.085027 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-13943bd0-0a3d-454d-812d-2d34973d0b08 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:47.085597 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-13943bd0-0a3d-454d-812d-2d34973d0b08 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:47.465298 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4a488ebf-a1a8-4a02-a27c-c1b0e76fda44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:47.466606 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4a488ebf-a1a8-4a02-a27c-c1b0e76fda44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:47.512476 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4a488ebf-a1a8-4a02-a27c-c1b0e76fda44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:47.513355 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4a488ebf-a1a8-4a02-a27c-c1b0e76fda44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:47.515044 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4a488ebf-a1a8-4a02-a27c-c1b0e76fda44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:47.515963 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4a488ebf-a1a8-4a02-a27c-c1b0e76fda44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:47.545124 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-13943bd0-0a3d-454d-812d-2d34973d0b08 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:47.563715 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-13943bd0-0a3d-454d-812d-2d34973d0b08 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:47.567281 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-13943bd0-0a3d-454d-812d-2d34973d0b08 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:47.572559 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-13943bd0-0a3d-454d-812d-2d34973d0b08 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.507185 Apr 20 18:35:47.575753 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 315/628] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:47 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:47.600641 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-309bfca4-463c-41e0-a5b1-4a81103859ff req-e16b62ae-4860-44ad-a2db-625e4fc70d4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e676908b-5435-4bff-93a1-63e80d658fc6", "name": "network-vif-deleted", "tag": "13ca762c-b03c-41e5-a456-423747f32eae"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:35:47.602569 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:35:47.602569 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:35:47.632881 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-309bfca4-463c-41e0-a5b1-4a81103859ff req-e16b62ae-4860-44ad-a2db-625e4fc70d4e service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:47.633408 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-309bfca4-463c-41e0-a5b1-4a81103859ff req-e16b62ae-4860-44ad-a2db-625e4fc70d4e service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:47.720815 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-309bfca4-463c-41e0-a5b1-4a81103859ff req-e16b62ae-4860-44ad-a2db-625e4fc70d4e service nova] Creating event network-vif-deleted:13ca762c-b03c-41e5-a456-423747f32eae for instance e676908b-5435-4bff-93a1-63e80d658fc6 on hv-cinder-78693 Apr 20 18:35:47.740446 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-309bfca4-463c-41e0-a5b1-4a81103859ff req-e16b62ae-4860-44ad-a2db-625e4fc70d4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144135 Apr 20 18:35:47.741148 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 316/629] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:35:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:35:47.859196 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-82390821-b038-4b53-b77c-35d49bcf8ec8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:47.859985 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-82390821-b038-4b53-b77c-35d49bcf8ec8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:47.888291 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-82390821-b038-4b53-b77c-35d49bcf8ec8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:47.888291 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-82390821-b038-4b53-b77c-35d49bcf8ec8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:47.889165 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-82390821-b038-4b53-b77c-35d49bcf8ec8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:47.889767 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-82390821-b038-4b53-b77c-35d49bcf8ec8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:47.984424 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-82390821-b038-4b53-b77c-35d49bcf8ec8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:47.985023 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-82390821-b038-4b53-b77c-35d49bcf8ec8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:47.985509 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-82390821-b038-4b53-b77c-35d49bcf8ec8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lazy-loading 'fault' on Instance uuid e676908b-5435-4bff-93a1-63e80d658fc6 {{(pid=100593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:35:48.054939 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-82390821-b038-4b53-b77c-35d49bcf8ec8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:48.067654 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-82390821-b038-4b53-b77c-35d49bcf8ec8 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1311 microversion: 2.1 time: 0.213044 Apr 20 18:35:48.075191 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 317/630] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:47 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1311 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:48.093064 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9b5d3758-8030-4ffd-86e7-b2dd67391904 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:48.094874 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9b5d3758-8030-4ffd-86e7-b2dd67391904 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:48.136642 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9b5d3758-8030-4ffd-86e7-b2dd67391904 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:48.137156 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9b5d3758-8030-4ffd-86e7-b2dd67391904 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:48.137288 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4a488ebf-a1a8-4a02-a27c-c1b0e76fda44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:48.138399 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9b5d3758-8030-4ffd-86e7-b2dd67391904 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:48.138895 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9b5d3758-8030-4ffd-86e7-b2dd67391904 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:48.148742 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4a488ebf-a1a8-4a02-a27c-c1b0e76fda44 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 200 len: 1319 microversion: 2.1 time: 0.692355 Apr 20 18:35:48.154326 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 314/631] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:47 2021] GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 1319 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:48.535587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9b5d3758-8030-4ffd-86e7-b2dd67391904 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:48.546694 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9b5d3758-8030-4ffd-86e7-b2dd67391904 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 200 len: 1514 microversion: 2.1 time: 0.467879 Apr 20 18:35:48.557523 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 318/632] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:48 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 1514 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:48.600784 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0e3368d5-6f44-4bb3-a503-e6099a028c4b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:48.602219 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0e3368d5-6f44-4bb3-a503-e6099a028c4b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:48.622508 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0e3368d5-6f44-4bb3-a503-e6099a028c4b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:48.623251 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0e3368d5-6f44-4bb3-a503-e6099a028c4b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:48.624351 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0e3368d5-6f44-4bb3-a503-e6099a028c4b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:48.626262 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0e3368d5-6f44-4bb3-a503-e6099a028c4b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:49.087141 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-79629621-b17e-40b7-8552-9b3941368cee tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:49.087881 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-79629621-b17e-40b7-8552-9b3941368cee tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:49.107574 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79629621-b17e-40b7-8552-9b3941368cee tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:49.108096 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79629621-b17e-40b7-8552-9b3941368cee tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:49.108976 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79629621-b17e-40b7-8552-9b3941368cee tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:49.109510 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79629621-b17e-40b7-8552-9b3941368cee tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:49.224411 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0e3368d5-6f44-4bb3-a503-e6099a028c4b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:49.236866 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0e3368d5-6f44-4bb3-a503-e6099a028c4b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:49.239027 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0e3368d5-6f44-4bb3-a503-e6099a028c4b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:49.240825 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0e3368d5-6f44-4bb3-a503-e6099a028c4b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.649256 Apr 20 18:35:49.242201 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 315/633] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:48 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:49.248608 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-65070051-266f-44b4-9637-c4c3bc994112 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:49.249601 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-65070051-266f-44b4-9637-c4c3bc994112 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:49.262101 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-65070051-266f-44b4-9637-c4c3bc994112 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:49.263028 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-65070051-266f-44b4-9637-c4c3bc994112 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:49.264240 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-65070051-266f-44b4-9637-c4c3bc994112 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:49.264904 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-65070051-266f-44b4-9637-c4c3bc994112 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:49.335242 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79629621-b17e-40b7-8552-9b3941368cee tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:49.335763 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79629621-b17e-40b7-8552-9b3941368cee tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:49.336294 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-79629621-b17e-40b7-8552-9b3941368cee tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lazy-loading 'fault' on Instance uuid e676908b-5435-4bff-93a1-63e80d658fc6 {{(pid=100593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:35:49.450688 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-79629621-b17e-40b7-8552-9b3941368cee tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:49.467059 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-79629621-b17e-40b7-8552-9b3941368cee tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 200 len: 1311 microversion: 2.1 time: 0.384556 Apr 20 18:35:49.467998 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 319/634] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:49 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 1311 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:35:49.570190 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-022957a0-97e1-4007-bb38-49b730c63c55 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:49.571119 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-022957a0-97e1-4007-bb38-49b730c63c55 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:49.612701 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-022957a0-97e1-4007-bb38-49b730c63c55 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:49.612701 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-022957a0-97e1-4007-bb38-49b730c63c55 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:49.612701 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-022957a0-97e1-4007-bb38-49b730c63c55 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:49.612701 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-022957a0-97e1-4007-bb38-49b730c63c55 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:50.001830 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-022957a0-97e1-4007-bb38-49b730c63c55 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:50.026995 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-022957a0-97e1-4007-bb38-49b730c63c55 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 200 len: 1514 microversion: 2.1 time: 0.463684 Apr 20 18:35:50.039784 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 320/635] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:49 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 1514 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:50.265460 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-17897802-d2ab-4fb8-a1eb-ea8c222efc9a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:50.266292 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-17897802-d2ab-4fb8-a1eb-ea8c222efc9a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:50.277939 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-17897802-d2ab-4fb8-a1eb-ea8c222efc9a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:50.278500 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-17897802-d2ab-4fb8-a1eb-ea8c222efc9a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:50.279374 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-17897802-d2ab-4fb8-a1eb-ea8c222efc9a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:50.281835 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-17897802-d2ab-4fb8-a1eb-ea8c222efc9a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:50.397076 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-65070051-266f-44b4-9637-c4c3bc994112 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:50.407330 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-65070051-266f-44b4-9637-c4c3bc994112 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 200 len: 1319 microversion: 2.1 time: 1.163284 Apr 20 18:35:50.412659 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 316/636] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:49 2021] GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 1319 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:50.421905 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-f1f38c5f-8bc9-4d50-9946-f657b3db36ed req-2fff116f-e919-41af-b22c-da01d1433528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba03ca2-62f0-4f02-b42f-5e99b7126063", "name": "network-vif-deleted", "tag": "fc49b83a-1530-42ad-b886-8026ee93c006"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:35:50.424371 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:35:50.424371 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:35:50.438900 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-f1f38c5f-8bc9-4d50-9946-f657b3db36ed req-2fff116f-e919-41af-b22c-da01d1433528 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:50.439489 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-f1f38c5f-8bc9-4d50-9946-f657b3db36ed req-2fff116f-e919-41af-b22c-da01d1433528 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:50.462215 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-f1f38c5f-8bc9-4d50-9946-f657b3db36ed req-2fff116f-e919-41af-b22c-da01d1433528 service nova] Creating event network-vif-deleted:fc49b83a-1530-42ad-b886-8026ee93c006 for instance 2ba03ca2-62f0-4f02-b42f-5e99b7126063 on hv-cinder-78693 Apr 20 18:35:50.468485 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-f1f38c5f-8bc9-4d50-9946-f657b3db36ed req-2fff116f-e919-41af-b22c-da01d1433528 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054398 Apr 20 18:35:50.469684 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 317/637] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:35:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:35:50.488176 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a69a296f-8d1f-4ac7-840f-1436b595349b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:50.490432 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a69a296f-8d1f-4ac7-840f-1436b595349b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: e676908b-5435-4bff-93a1-63e80d658fc6] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:50.511798 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a69a296f-8d1f-4ac7-840f-1436b595349b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:50.512683 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a69a296f-8d1f-4ac7-840f-1436b595349b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:50.513798 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a69a296f-8d1f-4ac7-840f-1436b595349b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:50.514515 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a69a296f-8d1f-4ac7-840f-1436b595349b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:50.592447 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-a69a296f-8d1f-4ac7-840f-1436b595349b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] HTTP exception thrown: Instance e676908b-5435-4bff-93a1-63e80d658fc6 could not be found. Apr 20 18:35:50.593643 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a69a296f-8d1f-4ac7-840f-1436b595349b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Returning 404 to user: Instance e676908b-5435-4bff-93a1-63e80d658fc6 could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:35:50.594762 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a69a296f-8d1f-4ac7-840f-1436b595349b tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6" status: 404 len: 111 microversion: 2.1 time: 0.111226 Apr 20 18:35:50.595916 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 318/638] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:50 2021] GET /compute/v2.1/servers/e676908b-5435-4bff-93a1-63e80d658fc6 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 18:35:50.612850 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-31f3b85f-7fce-41e4-8f63-d4ad7ddf173a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:50.613561 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-31f3b85f-7fce-41e4-8f63-d4ad7ddf173a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:50.640628 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-31f3b85f-7fce-41e4-8f63-d4ad7ddf173a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:50.641334 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-31f3b85f-7fce-41e4-8f63-d4ad7ddf173a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:50.645093 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-31f3b85f-7fce-41e4-8f63-d4ad7ddf173a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:50.645734 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-31f3b85f-7fce-41e4-8f63-d4ad7ddf173a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:50.794168 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-17897802-d2ab-4fb8-a1eb-ea8c222efc9a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:50.794855 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-31f3b85f-7fce-41e4-8f63-d4ad7ddf173a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Going to try to terminate instance {{(pid=100592) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:35:50.816185 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-17897802-d2ab-4fb8-a1eb-ea8c222efc9a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:50.822937 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-17897802-d2ab-4fb8-a1eb-ea8c222efc9a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:50.830819 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-17897802-d2ab-4fb8-a1eb-ea8c222efc9a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.571744 Apr 20 18:35:50.832979 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 321/639] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:50 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:50.989575 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-31f3b85f-7fce-41e4-8f63-d4ad7ddf173a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 204 len: 0 microversion: 2.1 time: 0.386111 Apr 20 18:35:50.990471 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 319/640] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:35:50 2021] DELETE /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:35:50.999330 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-77d55bcb-d163-465d-9ddc-b98281effa26 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:50.999975 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-77d55bcb-d163-465d-9ddc-b98281effa26 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:51.009223 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-77d55bcb-d163-465d-9ddc-b98281effa26 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:51.009766 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-77d55bcb-d163-465d-9ddc-b98281effa26 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:51.010626 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-77d55bcb-d163-465d-9ddc-b98281effa26 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:51.011118 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-77d55bcb-d163-465d-9ddc-b98281effa26 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:51.046046 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-df1afdbf-21e6-4521-9f9c-e4a402d627a1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:51.046825 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-df1afdbf-21e6-4521-9f9c-e4a402d627a1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:51.068705 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df1afdbf-21e6-4521-9f9c-e4a402d627a1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:51.069356 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df1afdbf-21e6-4521-9f9c-e4a402d627a1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:51.070428 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df1afdbf-21e6-4521-9f9c-e4a402d627a1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:51.070923 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df1afdbf-21e6-4521-9f9c-e4a402d627a1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:51.215128 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df1afdbf-21e6-4521-9f9c-e4a402d627a1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:51.215556 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df1afdbf-21e6-4521-9f9c-e4a402d627a1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:51.216075 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-df1afdbf-21e6-4521-9f9c-e4a402d627a1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lazy-loading 'fault' on Instance uuid 2ba03ca2-62f0-4f02-b42f-5e99b7126063 {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:35:51.313540 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-df1afdbf-21e6-4521-9f9c-e4a402d627a1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:51.335281 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-df1afdbf-21e6-4521-9f9c-e4a402d627a1 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 200 len: 1308 microversion: 2.1 time: 0.293489 Apr 20 18:35:51.336348 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 320/641] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:51 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 1308 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:51.368424 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-77d55bcb-d163-465d-9ddc-b98281effa26 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:51.389502 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-77d55bcb-d163-465d-9ddc-b98281effa26 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1520 microversion: 2.1 time: 0.394143 Apr 20 18:35:51.397805 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 322/642] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:50 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1520 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:51.446370 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5dbdaa0c-9b92-46f9-a888-aa1fc52af353 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:51.447152 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5dbdaa0c-9b92-46f9-a888-aa1fc52af353 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:51.455385 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5dbdaa0c-9b92-46f9-a888-aa1fc52af353 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:51.455895 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5dbdaa0c-9b92-46f9-a888-aa1fc52af353 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:51.456740 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5dbdaa0c-9b92-46f9-a888-aa1fc52af353 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:51.457236 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5dbdaa0c-9b92-46f9-a888-aa1fc52af353 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:51.742184 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5dbdaa0c-9b92-46f9-a888-aa1fc52af353 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:51.755937 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5dbdaa0c-9b92-46f9-a888-aa1fc52af353 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 200 len: 1509 microversion: 2.1 time: 0.314811 Apr 20 18:35:51.756612 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 321/643] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:51 2021] GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 1509 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:51.775122 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3dd3ee59-9373-4bd9-abaf-3817e2537286 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea2a2d2b-7c28-4027-8216-b231b9a759b4", "device": "/dev/sdb"}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:35:51.776466 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3dd3ee59-9373-4bd9-abaf-3817e2537286 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:51.785309 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3dd3ee59-9373-4bd9-abaf-3817e2537286 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:51.786676 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3dd3ee59-9373-4bd9-abaf-3817e2537286 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:51.787620 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3dd3ee59-9373-4bd9-abaf-3817e2537286 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:51.788124 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3dd3ee59-9373-4bd9-abaf-3817e2537286 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:51.856569 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-df3982a9-b3ee-4c3b-93b9-0b24647b4c57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:51.857381 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-df3982a9-b3ee-4c3b-93b9-0b24647b4c57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:51.883551 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df3982a9-b3ee-4c3b-93b9-0b24647b4c57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:51.884061 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df3982a9-b3ee-4c3b-93b9-0b24647b4c57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:51.884936 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df3982a9-b3ee-4c3b-93b9-0b24647b4c57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:51.885445 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df3982a9-b3ee-4c3b-93b9-0b24647b4c57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:52.153958 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-df3982a9-b3ee-4c3b-93b9-0b24647b4c57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:52.165740 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-df3982a9-b3ee-4c3b-93b9-0b24647b4c57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:52.167419 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-df3982a9-b3ee-4c3b-93b9-0b24647b4c57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:52.168684 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-df3982a9-b3ee-4c3b-93b9-0b24647b4c57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.318181 Apr 20 18:35:52.169332 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 322/644] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:51 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:52.354684 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5e125cdd-2489-4469-a6bc-c84675e2e0e6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:52.355551 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5e125cdd-2489-4469-a6bc-c84675e2e0e6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:52.364815 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5e125cdd-2489-4469-a6bc-c84675e2e0e6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:52.365479 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5e125cdd-2489-4469-a6bc-c84675e2e0e6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:52.366347 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5e125cdd-2489-4469-a6bc-c84675e2e0e6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:52.394199 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5e125cdd-2489-4469-a6bc-c84675e2e0e6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:52.484675 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5e125cdd-2489-4469-a6bc-c84675e2e0e6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:52.485454 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5e125cdd-2489-4469-a6bc-c84675e2e0e6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:52.486137 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-5e125cdd-2489-4469-a6bc-c84675e2e0e6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lazy-loading 'fault' on Instance uuid 2ba03ca2-62f0-4f02-b42f-5e99b7126063 {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:35:52.555568 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5e125cdd-2489-4469-a6bc-c84675e2e0e6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:52.567042 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5e125cdd-2489-4469-a6bc-c84675e2e0e6 tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 200 len: 1308 microversion: 2.1 time: 0.216280 Apr 20 18:35:52.568016 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 323/645] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:52 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 1308 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:52.579594 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-79798e23-eaf4-49a4-a972-0371c591cfc3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:52.580267 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-79798e23-eaf4-49a4-a972-0371c591cfc3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:52.588956 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79798e23-eaf4-49a4-a972-0371c591cfc3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:52.589494 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79798e23-eaf4-49a4-a972-0371c591cfc3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:52.590422 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79798e23-eaf4-49a4-a972-0371c591cfc3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:52.590806 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79798e23-eaf4-49a4-a972-0371c591cfc3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:52.954847 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-79798e23-eaf4-49a4-a972-0371c591cfc3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:52.966036 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-79798e23-eaf4-49a4-a972-0371c591cfc3 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1520 microversion: 2.1 time: 0.391152 Apr 20 18:35:52.966928 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 324/646] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:52 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1520 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:53.189072 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-00c38e71-51a3-4a97-b264-a659f923f18e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:53.189784 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-00c38e71-51a3-4a97-b264-a659f923f18e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:53.198866 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-00c38e71-51a3-4a97-b264-a659f923f18e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:53.199393 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-00c38e71-51a3-4a97-b264-a659f923f18e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:53.200372 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-00c38e71-51a3-4a97-b264-a659f923f18e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:53.200870 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-00c38e71-51a3-4a97-b264-a659f923f18e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:53.489900 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-00c38e71-51a3-4a97-b264-a659f923f18e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:53.502733 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-00c38e71-51a3-4a97-b264-a659f923f18e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:53.505060 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-00c38e71-51a3-4a97-b264-a659f923f18e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:53.507360 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-00c38e71-51a3-4a97-b264-a659f923f18e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.322054 Apr 20 18:35:53.508123 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 325/647] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:53 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:35:53.585584 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-48297795-06ca-4434-a2c5-3161576f6ccb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:53.586260 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-48297795-06ca-4434-a2c5-3161576f6ccb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:53.597077 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-48297795-06ca-4434-a2c5-3161576f6ccb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:53.598528 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-48297795-06ca-4434-a2c5-3161576f6ccb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:53.599464 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-48297795-06ca-4434-a2c5-3161576f6ccb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:53.599952 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-48297795-06ca-4434-a2c5-3161576f6ccb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:53.687750 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-48297795-06ca-4434-a2c5-3161576f6ccb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:53.688278 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-48297795-06ca-4434-a2c5-3161576f6ccb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:53.688821 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-48297795-06ca-4434-a2c5-3161576f6ccb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lazy-loading 'fault' on Instance uuid 2ba03ca2-62f0-4f02-b42f-5e99b7126063 {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:35:53.759104 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-48297795-06ca-4434-a2c5-3161576f6ccb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:53.768900 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-48297795-06ca-4434-a2c5-3161576f6ccb tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 200 len: 1308 microversion: 2.1 time: 0.187823 Apr 20 18:35:53.769575 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 326/648] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:53 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 1308 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:35:53.986925 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9b4bfb8a-11ae-40fa-b3b9-666bf370525e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:53.987729 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9b4bfb8a-11ae-40fa-b3b9-666bf370525e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:53.996815 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9b4bfb8a-11ae-40fa-b3b9-666bf370525e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:53.997318 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9b4bfb8a-11ae-40fa-b3b9-666bf370525e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:53.998210 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9b4bfb8a-11ae-40fa-b3b9-666bf370525e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:53.998702 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9b4bfb8a-11ae-40fa-b3b9-666bf370525e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:54.233064 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9b4bfb8a-11ae-40fa-b3b9-666bf370525e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:54.242711 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9b4bfb8a-11ae-40fa-b3b9-666bf370525e tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1520 microversion: 2.1 time: 0.259875 Apr 20 18:35:54.243358 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 327/649] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:53 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:35:54.534152 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c78953e3-7fc1-47df-8057-0fea67ee68ab tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:54.534832 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c78953e3-7fc1-47df-8057-0fea67ee68ab tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:54.543935 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c78953e3-7fc1-47df-8057-0fea67ee68ab tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:54.544788 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c78953e3-7fc1-47df-8057-0fea67ee68ab tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:54.545288 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c78953e3-7fc1-47df-8057-0fea67ee68ab tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:54.545813 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c78953e3-7fc1-47df-8057-0fea67ee68ab tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:54.720915 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3dd3ee59-9373-4bd9-abaf-3817e2537286 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "POST /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.950764 Apr 20 18:35:54.721900 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 323/650] 10.222.0.25 () {60 vars in 1313 bytes} [Tue Apr 20 18:35:51 2021] POST /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716/os-volume_attachments => generated 194 bytes in 2953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:35:54.790446 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5fdbf544-c2f1-4551-ac9e-aa22c3ac484a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:54.791265 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5fdbf544-c2f1-4551-ac9e-aa22c3ac484a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:54.803391 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5fdbf544-c2f1-4551-ac9e-aa22c3ac484a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:54.803391 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5fdbf544-c2f1-4551-ac9e-aa22c3ac484a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:54.803391 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5fdbf544-c2f1-4551-ac9e-aa22c3ac484a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:54.803725 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5fdbf544-c2f1-4551-ac9e-aa22c3ac484a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:54.892484 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5fdbf544-c2f1-4551-ac9e-aa22c3ac484a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:54.892989 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5fdbf544-c2f1-4551-ac9e-aa22c3ac484a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:54.893540 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-5fdbf544-c2f1-4551-ac9e-aa22c3ac484a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lazy-loading 'fault' on Instance uuid 2ba03ca2-62f0-4f02-b42f-5e99b7126063 {{(pid=100593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:35:54.966683 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5fdbf544-c2f1-4551-ac9e-aa22c3ac484a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b9bccd8af9040fd946ccb99ac8941dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '122aac624a214c548b32893da89374a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:54.978332 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5fdbf544-c2f1-4551-ac9e-aa22c3ac484a tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 200 len: 1308 microversion: 2.1 time: 0.193550 Apr 20 18:35:54.979011 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 324/651] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:54 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 1308 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:35:55.240045 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c78953e3-7fc1-47df-8057-0fea67ee68ab tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:55.250593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c78953e3-7fc1-47df-8057-0fea67ee68ab tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:55.252278 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c78953e3-7fc1-47df-8057-0fea67ee68ab tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:55.253663 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c78953e3-7fc1-47df-8057-0fea67ee68ab tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.723918 Apr 20 18:35:55.255628 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 328/652] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:54 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:55.261417 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8206680b-11d1-4d5e-83b9-92eff1a065cb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:55.262134 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8206680b-11d1-4d5e-83b9-92eff1a065cb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:55.271618 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8206680b-11d1-4d5e-83b9-92eff1a065cb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:55.272129 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8206680b-11d1-4d5e-83b9-92eff1a065cb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:55.272994 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8206680b-11d1-4d5e-83b9-92eff1a065cb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:55.273522 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8206680b-11d1-4d5e-83b9-92eff1a065cb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:55.525869 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8206680b-11d1-4d5e-83b9-92eff1a065cb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:55.535133 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8206680b-11d1-4d5e-83b9-92eff1a065cb tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1520 microversion: 2.1 time: 0.277688 Apr 20 18:35:55.536540 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 325/653] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:55 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1520 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:55.999091 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-41351b48-b43c-4e8c-8442-ff8bf16668df tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:55.999913 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-41351b48-b43c-4e8c-8442-ff8bf16668df tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] [instance: 2ba03ca2-62f0-4f02-b42f-5e99b7126063] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:56.009160 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-41351b48-b43c-4e8c-8442-ff8bf16668df tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:56.009745 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-41351b48-b43c-4e8c-8442-ff8bf16668df tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:56.010642 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-41351b48-b43c-4e8c-8442-ff8bf16668df tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:56.011132 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-41351b48-b43c-4e8c-8442-ff8bf16668df tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:56.067921 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-41351b48-b43c-4e8c-8442-ff8bf16668df tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] HTTP exception thrown: Instance 2ba03ca2-62f0-4f02-b42f-5e99b7126063 could not be found. Apr 20 18:35:56.068598 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-41351b48-b43c-4e8c-8442-ff8bf16668df tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] Returning 404 to user: Instance 2ba03ca2-62f0-4f02-b42f-5e99b7126063 could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:35:56.069569 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-41351b48-b43c-4e8c-8442-ff8bf16668df tempest-AttachVolumeNegativeTest-512727038 tempest-AttachVolumeNegativeTest-512727038-project] 10.222.0.25 "GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063" status: 404 len: 111 microversion: 2.1 time: 0.074588 Apr 20 18:35:56.073818 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 329/654] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:55 2021] GET /compute/v2.1/servers/2ba03ca2-62f0-4f02-b42f-5e99b7126063 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:35:56.275742 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-623038d6-eeb1-4245-b280-46326ea805da tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:56.276095 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-623038d6-eeb1-4245-b280-46326ea805da tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:56.284698 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-623038d6-eeb1-4245-b280-46326ea805da tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:56.286200 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-623038d6-eeb1-4245-b280-46326ea805da tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:56.287005 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-623038d6-eeb1-4245-b280-46326ea805da tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:56.287365 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-623038d6-eeb1-4245-b280-46326ea805da tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:56.558887 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ff53e75e-cca8-4bf0-abda-47a5531583af tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:56.560282 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ff53e75e-cca8-4bf0-abda-47a5531583af tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:56.576322 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ff53e75e-cca8-4bf0-abda-47a5531583af tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:56.577646 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ff53e75e-cca8-4bf0-abda-47a5531583af tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:56.579263 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ff53e75e-cca8-4bf0-abda-47a5531583af tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:56.580116 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ff53e75e-cca8-4bf0-abda-47a5531583af tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:56.714802 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-623038d6-eeb1-4245-b280-46326ea805da tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:56.731156 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-623038d6-eeb1-4245-b280-46326ea805da tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:56.733818 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-623038d6-eeb1-4245-b280-46326ea805da tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:56.735108 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-623038d6-eeb1-4245-b280-46326ea805da tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.463874 Apr 20 18:35:56.735959 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 326/655] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:56 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:35:56.968148 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ff53e75e-cca8-4bf0-abda-47a5531583af tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:56.979287 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ff53e75e-cca8-4bf0-abda-47a5531583af tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1520 microversion: 2.1 time: 0.428126 Apr 20 18:35:56.980408 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 330/656] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:56 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1520 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:57.756936 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9bd641b0-8171-4690-a2f9-f8fb5925cfe7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:57.757757 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9bd641b0-8171-4690-a2f9-f8fb5925cfe7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:57.766626 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9bd641b0-8171-4690-a2f9-f8fb5925cfe7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:57.767225 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9bd641b0-8171-4690-a2f9-f8fb5925cfe7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:57.768238 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9bd641b0-8171-4690-a2f9-f8fb5925cfe7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:57.768953 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9bd641b0-8171-4690-a2f9-f8fb5925cfe7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:57.952977 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a0d9e82a-f4af-4b09-b1d9-a1dffd66cb27 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:57.953594 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a0d9e82a-f4af-4b09-b1d9-a1dffd66cb27 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:57.962594 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a0d9e82a-f4af-4b09-b1d9-a1dffd66cb27 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:57.963116 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a0d9e82a-f4af-4b09-b1d9-a1dffd66cb27 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:57.964001 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a0d9e82a-f4af-4b09-b1d9-a1dffd66cb27 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:57.964719 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a0d9e82a-f4af-4b09-b1d9-a1dffd66cb27 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:58.169950 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-a0d9e82a-f4af-4b09-b1d9-a1dffd66cb27 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lazy-loading 'services' on Instance uuid 3b71640b-07ee-4677-8477-21da0a4166b1 {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:35:58.249727 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9bd641b0-8171-4690-a2f9-f8fb5925cfe7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:58.260867 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9bd641b0-8171-4690-a2f9-f8fb5925cfe7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:58.262840 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9bd641b0-8171-4690-a2f9-f8fb5925cfe7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:58.264307 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9bd641b0-8171-4690-a2f9-f8fb5925cfe7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.512456 Apr 20 18:35:58.265876 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 327/657] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:57 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:58.271049 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-516759b9-8d49-4a4e-b458-3ae4f2f7ba15 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:58.271787 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-516759b9-8d49-4a4e-b458-3ae4f2f7ba15 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:58.280091 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-516759b9-8d49-4a4e-b458-3ae4f2f7ba15 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:58.281155 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-516759b9-8d49-4a4e-b458-3ae4f2f7ba15 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:58.282253 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-516759b9-8d49-4a4e-b458-3ae4f2f7ba15 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:58.282938 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-516759b9-8d49-4a4e-b458-3ae4f2f7ba15 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:58.383807 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a0d9e82a-f4af-4b09-b1d9-a1dffd66cb27 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/os-volume_attachments/8e6d9959-4b1a-422b-a282-ffdb8d9b2e0b" status: 202 len: 0 microversion: 2.1 time: 0.433685 Apr 20 18:35:58.409172 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 331/658] 10.222.0.25 () {58 vars in 1406 bytes} [Tue Apr 20 18:35:57 2021] DELETE /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/os-volume_attachments/8e6d9959-4b1a-422b-a282-ffdb8d9b2e0b => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:35:58.663975 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-516759b9-8d49-4a4e-b458-3ae4f2f7ba15 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:58.676976 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-516759b9-8d49-4a4e-b458-3ae4f2f7ba15 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1520 microversion: 2.1 time: 0.408823 Apr 20 18:35:58.677831 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 328/659] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:58 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1520 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:35:59.287741 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f308724e-8829-4f22-b842-e2521120a80b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:59.288427 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f308724e-8829-4f22-b842-e2521120a80b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:59.297366 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f308724e-8829-4f22-b842-e2521120a80b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:59.297932 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f308724e-8829-4f22-b842-e2521120a80b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:59.298801 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f308724e-8829-4f22-b842-e2521120a80b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:59.299311 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f308724e-8829-4f22-b842-e2521120a80b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:59.681344 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f308724e-8829-4f22-b842-e2521120a80b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:59.696633 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-86eb98c7-8ac4-452a-9c3f-0a7746917912 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:35:59.697310 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-86eb98c7-8ac4-452a-9c3f-0a7746917912 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:35:59.702847 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f308724e-8829-4f22-b842-e2521120a80b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:59.704693 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f308724e-8829-4f22-b842-e2521120a80b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:35:59.717798 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f308724e-8829-4f22-b842-e2521120a80b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.425202 Apr 20 18:35:59.717798 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 332/660] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:35:59 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:35:59.718091 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-86eb98c7-8ac4-452a-9c3f-0a7746917912 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:59.718091 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-86eb98c7-8ac4-452a-9c3f-0a7746917912 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:35:59.718091 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-86eb98c7-8ac4-452a-9c3f-0a7746917912 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:35:59.718091 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-86eb98c7-8ac4-452a-9c3f-0a7746917912 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:00.021485 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-86eb98c7-8ac4-452a-9c3f-0a7746917912 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:00.038652 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-86eb98c7-8ac4-452a-9c3f-0a7746917912 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1520 microversion: 2.1 time: 0.346056 Apr 20 18:36:00.039954 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 329/661] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:35:59 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1520 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:00.734672 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0a7ae6b4-4261-4e87-8321-d93c0c6c4202 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:00.736045 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0a7ae6b4-4261-4e87-8321-d93c0c6c4202 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:00.757314 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0a7ae6b4-4261-4e87-8321-d93c0c6c4202 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:00.758325 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0a7ae6b4-4261-4e87-8321-d93c0c6c4202 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:00.772952 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0a7ae6b4-4261-4e87-8321-d93c0c6c4202 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:00.774026 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0a7ae6b4-4261-4e87-8321-d93c0c6c4202 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:01.062768 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-96c98d98-2c76-4e3b-8919-8ea25b87902a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:01.065756 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-96c98d98-2c76-4e3b-8919-8ea25b87902a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:01.088942 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-96c98d98-2c76-4e3b-8919-8ea25b87902a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:01.095447 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-96c98d98-2c76-4e3b-8919-8ea25b87902a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:01.100125 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-96c98d98-2c76-4e3b-8919-8ea25b87902a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:01.102457 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-96c98d98-2c76-4e3b-8919-8ea25b87902a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:01.487967 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-96c98d98-2c76-4e3b-8919-8ea25b87902a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:01.499097 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-96c98d98-2c76-4e3b-8919-8ea25b87902a tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1520 microversion: 2.1 time: 0.443858 Apr 20 18:36:01.500263 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 330/662] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:01 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1520 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:01.665976 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0a7ae6b4-4261-4e87-8321-d93c0c6c4202 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:01.697861 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0a7ae6b4-4261-4e87-8321-d93c0c6c4202 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:01.702937 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0a7ae6b4-4261-4e87-8321-d93c0c6c4202 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:01.705820 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0a7ae6b4-4261-4e87-8321-d93c0c6c4202 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.979923 Apr 20 18:36:01.707015 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 333/663] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:36:00 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:36:02.475116 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-c005913c-dc04-4490-85f9-46606d57cd05 req-fa2d108e-0de1-4455-b82b-75489f62e069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d", "name": "network-vif-deleted", "tag": "4d8858cf-3006-4b33-ae23-0eeb01318afd"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:36:02.484424 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:36:02.484424 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:36:02.503318 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-c005913c-dc04-4490-85f9-46606d57cd05 req-fa2d108e-0de1-4455-b82b-75489f62e069 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:02.504420 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-c005913c-dc04-4490-85f9-46606d57cd05 req-fa2d108e-0de1-4455-b82b-75489f62e069 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:02.528859 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c2c00911-6244-46a9-8b42-822eab91ba8f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:02.531489 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-c005913c-dc04-4490-85f9-46606d57cd05 req-fa2d108e-0de1-4455-b82b-75489f62e069 service nova] Creating event network-vif-deleted:4d8858cf-3006-4b33-ae23-0eeb01318afd for instance aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d on hv-cinder-78693 Apr 20 18:36:02.535943 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c2c00911-6244-46a9-8b42-822eab91ba8f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:02.545079 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-c005913c-dc04-4490-85f9-46606d57cd05 req-fa2d108e-0de1-4455-b82b-75489f62e069 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072016 Apr 20 18:36:02.546302 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 331/664] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:36:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:36:02.563619 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c2c00911-6244-46a9-8b42-822eab91ba8f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:02.564447 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c2c00911-6244-46a9-8b42-822eab91ba8f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:02.566123 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c2c00911-6244-46a9-8b42-822eab91ba8f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:02.566986 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c2c00911-6244-46a9-8b42-822eab91ba8f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:02.713259 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c2c00911-6244-46a9-8b42-822eab91ba8f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:02.714246 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c2c00911-6244-46a9-8b42-822eab91ba8f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:02.715235 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-c2c00911-6244-46a9-8b42-822eab91ba8f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lazy-loading 'fault' on Instance uuid aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:36:02.739317 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-74a3e6a6-9ae7-41a8-bfb2-fabacbd68d50 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:02.741696 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-74a3e6a6-9ae7-41a8-bfb2-fabacbd68d50 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:02.764600 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-74a3e6a6-9ae7-41a8-bfb2-fabacbd68d50 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:02.766614 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-74a3e6a6-9ae7-41a8-bfb2-fabacbd68d50 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:02.768724 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-74a3e6a6-9ae7-41a8-bfb2-fabacbd68d50 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:02.770546 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-74a3e6a6-9ae7-41a8-bfb2-fabacbd68d50 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:02.841966 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c2c00911-6244-46a9-8b42-822eab91ba8f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721d0f42e9ad4c15a58a04b94d319c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '604c8aa9b3d9478692cb6362f90fb56b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:02.855433 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c2c00911-6244-46a9-8b42-822eab91ba8f tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 200 len: 1311 microversion: 2.1 time: 0.336246 Apr 20 18:36:02.856338 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 334/665] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:02 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 1311 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:03.295109 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-74a3e6a6-9ae7-41a8-bfb2-fabacbd68d50 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:03.326641 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-74a3e6a6-9ae7-41a8-bfb2-fabacbd68d50 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:03.330962 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6d05749f-b0cb-476a-ab3d-382e71eb2e10 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:36:03.337709 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-74a3e6a6-9ae7-41a8-bfb2-fabacbd68d50 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:03.340689 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-74a3e6a6-9ae7-41a8-bfb2-fabacbd68d50 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.615052 Apr 20 18:36:03.342562 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 332/666] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:36:02 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:36:03.355435 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6d05749f-b0cb-476a-ab3d-382e71eb2e10 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:03.356869 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6d05749f-b0cb-476a-ab3d-382e71eb2e10 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:03.646165 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6d05749f-b0cb-476a-ab3d-382e71eb2e10 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Going to try to stop instance {{(pid=100592) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 20 18:36:03.792544 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6d05749f-b0cb-476a-ab3d-382e71eb2e10 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 202 len: 0 microversion: 2.1 time: 0.469252 Apr 20 18:36:03.793256 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 335/667] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:36:03 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:36:03.812179 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-dc473ca7-c008-408f-9249-575c9c5b29f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:03.814172 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-dc473ca7-c008-408f-9249-575c9c5b29f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:03.870365 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dc473ca7-c008-408f-9249-575c9c5b29f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:03.877514 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-81007c19-7544-47fd-9042-25b17c083282 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:03.878737 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-81007c19-7544-47fd-9042-25b17c083282 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] [instance: aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:03.879330 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dc473ca7-c008-408f-9249-575c9c5b29f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:03.882928 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dc473ca7-c008-408f-9249-575c9c5b29f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:03.886174 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dc473ca7-c008-408f-9249-575c9c5b29f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:03.896097 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-81007c19-7544-47fd-9042-25b17c083282 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:03.901620 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-81007c19-7544-47fd-9042-25b17c083282 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:03.902809 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-81007c19-7544-47fd-9042-25b17c083282 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:03.903277 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-81007c19-7544-47fd-9042-25b17c083282 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:04.089313 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-81007c19-7544-47fd-9042-25b17c083282 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] HTTP exception thrown: Instance aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d could not be found. Apr 20 18:36:04.091369 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-81007c19-7544-47fd-9042-25b17c083282 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] Returning 404 to user: Instance aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:36:04.092353 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-81007c19-7544-47fd-9042-25b17c083282 tempest-ServerRescueNegativeTestJSON-1939860265 tempest-ServerRescueNegativeTestJSON-1939860265-project] 10.222.0.25 "GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d" status: 404 len: 111 microversion: 2.1 time: 0.219749 Apr 20 18:36:04.093351 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 336/668] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:03 2021] GET /compute/v2.1/servers/aa3a06a0-7a26-42b6-a5e9-f45254dd3c7d => generated 111 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 18:36:04.390288 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2ddc2996-ffc9-4477-8c07-711e24d91db7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:04.399243 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2ddc2996-ffc9-4477-8c07-711e24d91db7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:04.423935 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2ddc2996-ffc9-4477-8c07-711e24d91db7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:04.425514 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2ddc2996-ffc9-4477-8c07-711e24d91db7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:04.429355 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2ddc2996-ffc9-4477-8c07-711e24d91db7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:04.430579 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2ddc2996-ffc9-4477-8c07-711e24d91db7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:04.751117 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2ddc2996-ffc9-4477-8c07-711e24d91db7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:04.762855 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2ddc2996-ffc9-4477-8c07-711e24d91db7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:04.766226 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2ddc2996-ffc9-4477-8c07-711e24d91db7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:04.768171 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2ddc2996-ffc9-4477-8c07-711e24d91db7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.395847 Apr 20 18:36:04.769204 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 337/669] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:36:04 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:36:05.214498 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-dc473ca7-c008-408f-9249-575c9c5b29f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:05.225247 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-dc473ca7-c008-408f-9249-575c9c5b29f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1677 microversion: 2.1 time: 1.426320 Apr 20 18:36:05.236581 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 333/670] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:03 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1677 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:05.795481 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a2fddff6-03a5-4b85-b9e3-bf7eb44ff60c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:05.796632 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a2fddff6-03a5-4b85-b9e3-bf7eb44ff60c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:05.806297 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a2fddff6-03a5-4b85-b9e3-bf7eb44ff60c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:05.806808 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a2fddff6-03a5-4b85-b9e3-bf7eb44ff60c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:05.807689 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a2fddff6-03a5-4b85-b9e3-bf7eb44ff60c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:05.808191 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a2fddff6-03a5-4b85-b9e3-bf7eb44ff60c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:06.113019 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a2fddff6-03a5-4b85-b9e3-bf7eb44ff60c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:06.125036 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a2fddff6-03a5-4b85-b9e3-bf7eb44ff60c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:06.126771 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a2fddff6-03a5-4b85-b9e3-bf7eb44ff60c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:06.128233 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a2fddff6-03a5-4b85-b9e3-bf7eb44ff60c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.337449 Apr 20 18:36:06.129020 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 338/671] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:36:05 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:36:06.253655 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-258933bf-dc53-40bc-af64-6be11138e01e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:06.255550 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-258933bf-dc53-40bc-af64-6be11138e01e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:06.272545 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-258933bf-dc53-40bc-af64-6be11138e01e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:06.273442 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-258933bf-dc53-40bc-af64-6be11138e01e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:06.274952 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-258933bf-dc53-40bc-af64-6be11138e01e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:06.275849 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-258933bf-dc53-40bc-af64-6be11138e01e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:06.836799 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-258933bf-dc53-40bc-af64-6be11138e01e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:06.847828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-258933bf-dc53-40bc-af64-6be11138e01e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1677 microversion: 2.1 time: 0.602365 Apr 20 18:36:06.862888 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 334/672] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:06 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1677 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:07.148483 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ef630dcd-5c6d-4f82-9e64-0f694e652db5 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:07.149342 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ef630dcd-5c6d-4f82-9e64-0f694e652db5 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:07.158747 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ef630dcd-5c6d-4f82-9e64-0f694e652db5 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:07.159340 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ef630dcd-5c6d-4f82-9e64-0f694e652db5 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:07.160900 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ef630dcd-5c6d-4f82-9e64-0f694e652db5 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:07.161652 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ef630dcd-5c6d-4f82-9e64-0f694e652db5 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:07.440648 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ef630dcd-5c6d-4f82-9e64-0f694e652db5 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:07.463213 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ef630dcd-5c6d-4f82-9e64-0f694e652db5 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:07.467400 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ef630dcd-5c6d-4f82-9e64-0f694e652db5 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:07.480870 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ef630dcd-5c6d-4f82-9e64-0f694e652db5 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.336394 Apr 20 18:36:07.487079 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 339/673] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:36:07 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:36:07.873322 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4630fc07-423a-43ae-80cd-ff44b7728a11 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:07.874743 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4630fc07-423a-43ae-80cd-ff44b7728a11 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:07.895409 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4630fc07-423a-43ae-80cd-ff44b7728a11 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:07.895409 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4630fc07-423a-43ae-80cd-ff44b7728a11 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:07.895409 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4630fc07-423a-43ae-80cd-ff44b7728a11 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:07.895409 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4630fc07-423a-43ae-80cd-ff44b7728a11 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:08.518034 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6a44ab73-20e2-4d82-8968-ff684cbcb404 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:08.519108 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6a44ab73-20e2-4d82-8968-ff684cbcb404 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:08.528674 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6a44ab73-20e2-4d82-8968-ff684cbcb404 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:08.529650 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6a44ab73-20e2-4d82-8968-ff684cbcb404 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:08.530694 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6a44ab73-20e2-4d82-8968-ff684cbcb404 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:08.532060 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6a44ab73-20e2-4d82-8968-ff684cbcb404 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:08.549365 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4630fc07-423a-43ae-80cd-ff44b7728a11 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:08.594834 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4630fc07-423a-43ae-80cd-ff44b7728a11 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1677 microversion: 2.1 time: 0.729507 Apr 20 18:36:08.596299 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 335/674] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:07 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1677 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:08.916718 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6a44ab73-20e2-4d82-8968-ff684cbcb404 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:08.932971 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6a44ab73-20e2-4d82-8968-ff684cbcb404 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:08.934798 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6a44ab73-20e2-4d82-8968-ff684cbcb404 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:08.936468 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6a44ab73-20e2-4d82-8968-ff684cbcb404 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.422758 Apr 20 18:36:08.937111 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 340/675] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:36:08 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:36:09.627082 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-84f3423f-6f07-478b-bcec-84e28b6330fe tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:09.628099 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-84f3423f-6f07-478b-bcec-84e28b6330fe tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:09.639048 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-84f3423f-6f07-478b-bcec-84e28b6330fe tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:09.640136 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-84f3423f-6f07-478b-bcec-84e28b6330fe tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:09.641256 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-84f3423f-6f07-478b-bcec-84e28b6330fe tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:09.641990 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-84f3423f-6f07-478b-bcec-84e28b6330fe tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:09.975962 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ccbc272b-02c5-4f96-aae1-724df220955a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:09.977743 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ccbc272b-02c5-4f96-aae1-724df220955a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:10.001234 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ccbc272b-02c5-4f96-aae1-724df220955a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:10.002651 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ccbc272b-02c5-4f96-aae1-724df220955a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:10.005359 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ccbc272b-02c5-4f96-aae1-724df220955a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:10.014385 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ccbc272b-02c5-4f96-aae1-724df220955a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:10.035855 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-84f3423f-6f07-478b-bcec-84e28b6330fe tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:10.061990 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-84f3423f-6f07-478b-bcec-84e28b6330fe tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1677 microversion: 2.1 time: 0.438547 Apr 20 18:36:10.063460 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 336/676] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:09 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1677 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:10.684211 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ccbc272b-02c5-4f96-aae1-724df220955a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:10.696932 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ccbc272b-02c5-4f96-aae1-724df220955a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:10.698731 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ccbc272b-02c5-4f96-aae1-724df220955a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:10.700225 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ccbc272b-02c5-4f96-aae1-724df220955a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.733471 Apr 20 18:36:10.700857 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 341/677] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:36:09 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:36:11.084687 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ae4abb59-9175-4778-b06c-c4f8f2114699 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:11.085366 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ae4abb59-9175-4778-b06c-c4f8f2114699 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:11.094376 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ae4abb59-9175-4778-b06c-c4f8f2114699 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:11.095094 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ae4abb59-9175-4778-b06c-c4f8f2114699 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:11.096903 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ae4abb59-9175-4778-b06c-c4f8f2114699 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:11.098242 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ae4abb59-9175-4778-b06c-c4f8f2114699 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:11.246804 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-ddcdf27c-ab70-4368-8fee-e7202df0cc8f req-fbe5d135-fc98-4844-a5d6-61e8b99d60e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e532f85-bed6-43d3-969d-3a2688b4638b", "name": "network-vif-plugged", "status": "completed", "tag": "36707b77-0efd-41e0-9dc6-6332c175126e"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:36:11.248993 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:36:11.248993 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:36:11.260061 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-ddcdf27c-ab70-4368-8fee-e7202df0cc8f req-fbe5d135-fc98-4844-a5d6-61e8b99d60e6 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:11.261544 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-ddcdf27c-ab70-4368-8fee-e7202df0cc8f req-fbe5d135-fc98-4844-a5d6-61e8b99d60e6 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:11.282840 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-ddcdf27c-ab70-4368-8fee-e7202df0cc8f req-fbe5d135-fc98-4844-a5d6-61e8b99d60e6 service nova] Creating event network-vif-plugged:36707b77-0efd-41e0-9dc6-6332c175126e for instance 1e532f85-bed6-43d3-969d-3a2688b4638b on hv-cinder-78693 Apr 20 18:36:11.289988 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-ddcdf27c-ab70-4368-8fee-e7202df0cc8f req-fbe5d135-fc98-4844-a5d6-61e8b99d60e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046890 Apr 20 18:36:11.296687 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 342/678] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:36:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:36:11.350044 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ae4abb59-9175-4778-b06c-c4f8f2114699 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:11.360547 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ae4abb59-9175-4778-b06c-c4f8f2114699 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1677 microversion: 2.1 time: 0.280588 Apr 20 18:36:11.361718 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 337/679] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:11 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1677 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:11.721466 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1704dde6-43b9-41ec-a2d9-4f97fa7ec6cb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:11.722355 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1704dde6-43b9-41ec-a2d9-4f97fa7ec6cb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:11.731040 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1704dde6-43b9-41ec-a2d9-4f97fa7ec6cb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:11.731640 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1704dde6-43b9-41ec-a2d9-4f97fa7ec6cb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:11.732486 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1704dde6-43b9-41ec-a2d9-4f97fa7ec6cb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:11.732985 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1704dde6-43b9-41ec-a2d9-4f97fa7ec6cb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:12.171560 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1704dde6-43b9-41ec-a2d9-4f97fa7ec6cb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:12.184527 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1704dde6-43b9-41ec-a2d9-4f97fa7ec6cb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:12.189927 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1704dde6-43b9-41ec-a2d9-4f97fa7ec6cb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:12.192083 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1704dde6-43b9-41ec-a2d9-4f97fa7ec6cb tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.474683 Apr 20 18:36:12.197561 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 343/680] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:36:11 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:36:12.381863 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-307156f8-601b-47fe-92a6-6c05fd47bd7b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:12.383075 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-307156f8-601b-47fe-92a6-6c05fd47bd7b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:12.392760 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-307156f8-601b-47fe-92a6-6c05fd47bd7b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:12.393541 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-307156f8-601b-47fe-92a6-6c05fd47bd7b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:12.394918 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-307156f8-601b-47fe-92a6-6c05fd47bd7b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:12.396012 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-307156f8-601b-47fe-92a6-6c05fd47bd7b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:12.675264 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-307156f8-601b-47fe-92a6-6c05fd47bd7b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:12.686747 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-307156f8-601b-47fe-92a6-6c05fd47bd7b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1677 microversion: 2.1 time: 0.309567 Apr 20 18:36:12.687559 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 338/681] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:12 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1677 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:13.212000 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-526415f2-869a-4190-915b-d1506cea03e1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:13.212579 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-526415f2-869a-4190-915b-d1506cea03e1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:13.220790 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-526415f2-869a-4190-915b-d1506cea03e1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:13.221480 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-526415f2-869a-4190-915b-d1506cea03e1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:13.223714 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-526415f2-869a-4190-915b-d1506cea03e1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:13.224642 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-526415f2-869a-4190-915b-d1506cea03e1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:13.511011 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-526415f2-869a-4190-915b-d1506cea03e1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:13.523368 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-526415f2-869a-4190-915b-d1506cea03e1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:13.525516 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-526415f2-869a-4190-915b-d1506cea03e1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:13.526844 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-526415f2-869a-4190-915b-d1506cea03e1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.319059 Apr 20 18:36:13.533587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 344/682] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:36:13 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:36:13.707782 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-29a30c3f-c71c-476e-9f24-a179566d03d7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:13.708474 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-29a30c3f-c71c-476e-9f24-a179566d03d7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:13.717023 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29a30c3f-c71c-476e-9f24-a179566d03d7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:13.717611 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29a30c3f-c71c-476e-9f24-a179566d03d7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:13.718558 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29a30c3f-c71c-476e-9f24-a179566d03d7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:13.718987 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29a30c3f-c71c-476e-9f24-a179566d03d7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:14.029351 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-29a30c3f-c71c-476e-9f24-a179566d03d7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:14.048918 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-29a30c3f-c71c-476e-9f24-a179566d03d7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1677 microversion: 2.1 time: 0.345425 Apr 20 18:36:14.050153 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 339/683] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:13 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1677 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:14.550275 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d6c6d083-8dc2-443d-9e72-d6b061e9c21f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:14.552086 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d6c6d083-8dc2-443d-9e72-d6b061e9c21f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:14.564605 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d6c6d083-8dc2-443d-9e72-d6b061e9c21f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:14.565450 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d6c6d083-8dc2-443d-9e72-d6b061e9c21f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:14.567198 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d6c6d083-8dc2-443d-9e72-d6b061e9c21f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:14.567891 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d6c6d083-8dc2-443d-9e72-d6b061e9c21f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:14.826606 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d6c6d083-8dc2-443d-9e72-d6b061e9c21f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:14.840781 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d6c6d083-8dc2-443d-9e72-d6b061e9c21f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:14.843106 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d6c6d083-8dc2-443d-9e72-d6b061e9c21f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:14.844676 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d6c6d083-8dc2-443d-9e72-d6b061e9c21f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.301143 Apr 20 18:36:14.845490 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 345/684] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:36:14 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:36:15.074230 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6bd5b731-00f7-4b73-81b8-24f54f0f3962 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:15.075583 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6bd5b731-00f7-4b73-81b8-24f54f0f3962 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:15.085304 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6bd5b731-00f7-4b73-81b8-24f54f0f3962 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:15.085908 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6bd5b731-00f7-4b73-81b8-24f54f0f3962 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:15.086846 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6bd5b731-00f7-4b73-81b8-24f54f0f3962 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:15.087363 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6bd5b731-00f7-4b73-81b8-24f54f0f3962 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:15.369461 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6bd5b731-00f7-4b73-81b8-24f54f0f3962 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:15.406386 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6bd5b731-00f7-4b73-81b8-24f54f0f3962 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1677 microversion: 2.1 time: 0.327025 Apr 20 18:36:15.421428 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 340/685] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:15 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1677 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:15.866657 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0ffe3779-afc0-4cd5-8d82-c475c7419b9b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:15.867335 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0ffe3779-afc0-4cd5-8d82-c475c7419b9b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:15.877998 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0ffe3779-afc0-4cd5-8d82-c475c7419b9b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:15.878687 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0ffe3779-afc0-4cd5-8d82-c475c7419b9b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:15.879875 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0ffe3779-afc0-4cd5-8d82-c475c7419b9b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:15.880546 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0ffe3779-afc0-4cd5-8d82-c475c7419b9b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:16.188188 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0ffe3779-afc0-4cd5-8d82-c475c7419b9b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:16.200135 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0ffe3779-afc0-4cd5-8d82-c475c7419b9b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:16.201999 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0ffe3779-afc0-4cd5-8d82-c475c7419b9b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:16.203256 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0ffe3779-afc0-4cd5-8d82-c475c7419b9b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.341450 Apr 20 18:36:16.203916 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 346/686] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:36:15 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:36:16.438335 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-89b3d4d1-6e59-4524-b81a-028279b04337 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:16.439491 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-89b3d4d1-6e59-4524-b81a-028279b04337 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:16.455855 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-89b3d4d1-6e59-4524-b81a-028279b04337 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:16.456482 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-89b3d4d1-6e59-4524-b81a-028279b04337 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:16.458616 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-89b3d4d1-6e59-4524-b81a-028279b04337 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:16.459601 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-89b3d4d1-6e59-4524-b81a-028279b04337 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:16.805787 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-89b3d4d1-6e59-4524-b81a-028279b04337 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:16.815295 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-89b3d4d1-6e59-4524-b81a-028279b04337 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1677 microversion: 2.1 time: 0.384047 Apr 20 18:36:16.817132 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 341/687] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:16 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1677 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:17.228126 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-df2e07aa-67a0-43d7-956d-2098b4fbce04 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:17.228126 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-df2e07aa-67a0-43d7-956d-2098b4fbce04 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:17.235633 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df2e07aa-67a0-43d7-956d-2098b4fbce04 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:17.236312 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df2e07aa-67a0-43d7-956d-2098b4fbce04 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:17.237639 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df2e07aa-67a0-43d7-956d-2098b4fbce04 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:17.238756 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df2e07aa-67a0-43d7-956d-2098b4fbce04 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:17.574408 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-df2e07aa-67a0-43d7-956d-2098b4fbce04 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:17.586777 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-df2e07aa-67a0-43d7-956d-2098b4fbce04 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:17.588660 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-df2e07aa-67a0-43d7-956d-2098b4fbce04 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:17.590029 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-df2e07aa-67a0-43d7-956d-2098b4fbce04 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.369765 Apr 20 18:36:17.590652 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 347/688] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:36:17 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:36:17.841234 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-25e1ac95-17fb-4819-ade9-82ea4d3434c4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:17.853182 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-25e1ac95-17fb-4819-ade9-82ea4d3434c4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:17.881288 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-25e1ac95-17fb-4819-ade9-82ea4d3434c4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:17.882906 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-25e1ac95-17fb-4819-ade9-82ea4d3434c4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:17.884777 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-25e1ac95-17fb-4819-ade9-82ea4d3434c4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:17.885903 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-25e1ac95-17fb-4819-ade9-82ea4d3434c4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:18.323809 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-25e1ac95-17fb-4819-ade9-82ea4d3434c4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:18.340872 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-25e1ac95-17fb-4819-ade9-82ea4d3434c4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1677 microversion: 2.1 time: 0.505830 Apr 20 18:36:18.349289 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 342/689] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:17 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1677 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:18.623283 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-29b5eb77-604b-4a22-a929-884f1641ac79 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:18.625797 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-29b5eb77-604b-4a22-a929-884f1641ac79 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:18.639200 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29b5eb77-604b-4a22-a929-884f1641ac79 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:18.640007 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29b5eb77-604b-4a22-a929-884f1641ac79 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:18.641572 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29b5eb77-604b-4a22-a929-884f1641ac79 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:18.642452 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29b5eb77-604b-4a22-a929-884f1641ac79 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:18.924585 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-29b5eb77-604b-4a22-a929-884f1641ac79 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:18.945528 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-29b5eb77-604b-4a22-a929-884f1641ac79 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:18.948842 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-29b5eb77-604b-4a22-a929-884f1641ac79 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:18.951153 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-29b5eb77-604b-4a22-a929-884f1641ac79 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1807 microversion: 2.20 time: 0.333486 Apr 20 18:36:18.952125 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 348/690] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:36:18 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1807 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:36:19.369081 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9415a151-74f3-4cc5-896e-ffe816501714 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:19.369951 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9415a151-74f3-4cc5-896e-ffe816501714 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:19.380608 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9415a151-74f3-4cc5-896e-ffe816501714 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:19.381282 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9415a151-74f3-4cc5-896e-ffe816501714 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:19.382505 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9415a151-74f3-4cc5-896e-ffe816501714 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:19.383226 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9415a151-74f3-4cc5-896e-ffe816501714 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:19.841071 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9415a151-74f3-4cc5-896e-ffe816501714 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:19.858867 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9415a151-74f3-4cc5-896e-ffe816501714 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1677 microversion: 2.1 time: 0.496665 Apr 20 18:36:19.860124 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 343/691] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:19 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1677 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:19.986129 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6f27ad9f-c120-436e-9ed4-73a04a1e09df tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:19.988862 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6f27ad9f-c120-436e-9ed4-73a04a1e09df tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:20.010692 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6f27ad9f-c120-436e-9ed4-73a04a1e09df tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:20.011260 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6f27ad9f-c120-436e-9ed4-73a04a1e09df tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:20.012599 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6f27ad9f-c120-436e-9ed4-73a04a1e09df tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:20.013127 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6f27ad9f-c120-436e-9ed4-73a04a1e09df tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:20.293977 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6f27ad9f-c120-436e-9ed4-73a04a1e09df tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:20.305609 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6f27ad9f-c120-436e-9ed4-73a04a1e09df tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:20.307407 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6f27ad9f-c120-436e-9ed4-73a04a1e09df tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:20.308690 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6f27ad9f-c120-436e-9ed4-73a04a1e09df tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1794 microversion: 2.20 time: 0.331173 Apr 20 18:36:20.309333 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 349/692] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:36:19 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1794 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:36:20.881743 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c9a6cd4d-1da5-4448-93ce-9dca8b9810a4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:20.882438 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c9a6cd4d-1da5-4448-93ce-9dca8b9810a4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:20.891161 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c9a6cd4d-1da5-4448-93ce-9dca8b9810a4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:20.891680 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c9a6cd4d-1da5-4448-93ce-9dca8b9810a4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:20.892559 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c9a6cd4d-1da5-4448-93ce-9dca8b9810a4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:20.893055 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c9a6cd4d-1da5-4448-93ce-9dca8b9810a4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:21.192367 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c9a6cd4d-1da5-4448-93ce-9dca8b9810a4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:21.216046 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c9a6cd4d-1da5-4448-93ce-9dca8b9810a4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1677 microversion: 2.1 time: 0.340183 Apr 20 18:36:21.216844 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 344/693] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:20 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1677 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:21.263775 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ec98f0a7-e3f2-466f-8531-117ead26cf8a tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:21.264328 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ec98f0a7-e3f2-466f-8531-117ead26cf8a tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:21.273466 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ec98f0a7-e3f2-466f-8531-117ead26cf8a tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:21.274009 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ec98f0a7-e3f2-466f-8531-117ead26cf8a tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:21.274808 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ec98f0a7-e3f2-466f-8531-117ead26cf8a tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:21.275294 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ec98f0a7-e3f2-466f-8531-117ead26cf8a tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:21.474323 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-ec98f0a7-e3f2-466f-8531-117ead26cf8a tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lazy-loading 'services' on Instance uuid 297d64ba-9465-41f0-8806-f19d3ad6b716 {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:36:21.651248 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ec98f0a7-e3f2-466f-8531-117ead26cf8a tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "DELETE /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716/os-volume_attachments/ea2a2d2b-7c28-4027-8216-b231b9a759b4" status: 202 len: 0 microversion: 2.1 time: 0.391513 Apr 20 18:36:21.651898 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 350/694] 10.222.0.25 () {58 vars in 1406 bytes} [Tue Apr 20 18:36:21 2021] DELETE /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716/os-volume_attachments/ea2a2d2b-7c28-4027-8216-b231b9a759b4 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:36:22.243099 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c614639a-a81a-4e15-b2bc-6bc3503bfd79 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:22.244714 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c614639a-a81a-4e15-b2bc-6bc3503bfd79 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:22.254183 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c614639a-a81a-4e15-b2bc-6bc3503bfd79 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:22.254741 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c614639a-a81a-4e15-b2bc-6bc3503bfd79 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:22.255617 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c614639a-a81a-4e15-b2bc-6bc3503bfd79 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:22.256111 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c614639a-a81a-4e15-b2bc-6bc3503bfd79 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:22.622457 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c614639a-a81a-4e15-b2bc-6bc3503bfd79 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:22.642205 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c614639a-a81a-4e15-b2bc-6bc3503bfd79 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1654 microversion: 2.1 time: 0.404526 Apr 20 18:36:22.643625 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 345/695] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:22 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1654 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:22.663088 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-35238564-1392-4289-ac40-7fe35de83b55 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:36:22.672301 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-35238564-1392-4289-ac40-7fe35de83b55 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:22.672725 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-35238564-1392-4289-ac40-7fe35de83b55 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:22.744797 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-35238564-1392-4289-ac40-7fe35de83b55 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Going to try to start instance {{(pid=100592) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 20 18:36:22.852253 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-35238564-1392-4289-ac40-7fe35de83b55 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action" status: 202 len: 0 microversion: 2.1 time: 0.193713 Apr 20 18:36:22.853410 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 351/696] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:36:22 2021] POST /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:36:22.867809 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-12171bbd-7ff2-45da-92cf-5bc3936be302 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:22.869421 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-12171bbd-7ff2-45da-92cf-5bc3936be302 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:22.889540 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-12171bbd-7ff2-45da-92cf-5bc3936be302 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:22.890773 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-12171bbd-7ff2-45da-92cf-5bc3936be302 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:22.913687 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-12171bbd-7ff2-45da-92cf-5bc3936be302 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:22.914777 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-12171bbd-7ff2-45da-92cf-5bc3936be302 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:23.072719 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f447a0aa-87c9-4661-889e-c751a3ddbff3 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:23.077079 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f447a0aa-87c9-4661-889e-c751a3ddbff3 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:23.089726 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f447a0aa-87c9-4661-889e-c751a3ddbff3 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:23.090509 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f447a0aa-87c9-4661-889e-c751a3ddbff3 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:23.091549 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f447a0aa-87c9-4661-889e-c751a3ddbff3 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:23.092239 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f447a0aa-87c9-4661-889e-c751a3ddbff3 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:23.354642 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f447a0aa-87c9-4661-889e-c751a3ddbff3 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Going to try to terminate instance {{(pid=100592) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:36:23.565489 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-12171bbd-7ff2-45da-92cf-5bc3936be302 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:23.584231 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-12171bbd-7ff2-45da-92cf-5bc3936be302 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1663 microversion: 2.1 time: 0.724671 Apr 20 18:36:23.586682 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 346/697] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:22 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1663 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:23.683775 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f447a0aa-87c9-4661-889e-c751a3ddbff3 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "DELETE /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 204 len: 0 microversion: 2.1 time: 0.623664 Apr 20 18:36:23.684431 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 352/698] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:36:23 2021] DELETE /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:36:23.697544 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2d928b08-728f-4a03-aa6d-3770d8db38bd tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:23.698991 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2d928b08-728f-4a03-aa6d-3770d8db38bd tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:23.715320 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2d928b08-728f-4a03-aa6d-3770d8db38bd tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:23.716170 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2d928b08-728f-4a03-aa6d-3770d8db38bd tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:23.717997 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2d928b08-728f-4a03-aa6d-3770d8db38bd tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:23.719523 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2d928b08-728f-4a03-aa6d-3770d8db38bd tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:24.210517 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2d928b08-728f-4a03-aa6d-3770d8db38bd tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:24.234827 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2d928b08-728f-4a03-aa6d-3770d8db38bd tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 200 len: 1515 microversion: 2.1 time: 0.543160 Apr 20 18:36:24.236310 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 347/699] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:23 2021] GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 1515 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:24.610793 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-93493525-1010-4065-bc96-8ae8a39b1a55 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:24.613702 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-93493525-1010-4065-bc96-8ae8a39b1a55 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:24.629628 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-93493525-1010-4065-bc96-8ae8a39b1a55 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:24.630783 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-93493525-1010-4065-bc96-8ae8a39b1a55 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:24.632653 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-93493525-1010-4065-bc96-8ae8a39b1a55 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:24.633827 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-93493525-1010-4065-bc96-8ae8a39b1a55 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:25.064701 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-93493525-1010-4065-bc96-8ae8a39b1a55 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:25.080887 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-93493525-1010-4065-bc96-8ae8a39b1a55 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1663 microversion: 2.1 time: 0.478441 Apr 20 18:36:25.082286 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 353/700] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:24 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1663 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:25.271343 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d1259387-aaf9-4a07-a70a-0a093fe14a33 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:25.272810 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d1259387-aaf9-4a07-a70a-0a093fe14a33 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:25.286608 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d1259387-aaf9-4a07-a70a-0a093fe14a33 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:25.287715 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d1259387-aaf9-4a07-a70a-0a093fe14a33 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:25.289048 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d1259387-aaf9-4a07-a70a-0a093fe14a33 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:25.289844 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d1259387-aaf9-4a07-a70a-0a093fe14a33 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:26.113830 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b33fece9-f41f-4b75-8d3e-e846973ca9fd tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:26.116019 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b33fece9-f41f-4b75-8d3e-e846973ca9fd tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:26.134064 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b33fece9-f41f-4b75-8d3e-e846973ca9fd tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:26.135382 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b33fece9-f41f-4b75-8d3e-e846973ca9fd tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:26.137263 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b33fece9-f41f-4b75-8d3e-e846973ca9fd tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:26.138470 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b33fece9-f41f-4b75-8d3e-e846973ca9fd tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:26.195904 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d1259387-aaf9-4a07-a70a-0a093fe14a33 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:26.214715 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d1259387-aaf9-4a07-a70a-0a093fe14a33 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 200 len: 1515 microversion: 2.1 time: 0.952102 Apr 20 18:36:26.216133 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 348/701] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:25 2021] GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 1515 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:26.569774 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b33fece9-f41f-4b75-8d3e-e846973ca9fd tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:26.593994 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b33fece9-f41f-4b75-8d3e-e846973ca9fd tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1663 microversion: 2.1 time: 0.488388 Apr 20 18:36:26.595316 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 354/702] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:26 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1663 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:27.243351 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-79730e5f-7ace-4041-b0e4-e486420efb29 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:27.244557 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-79730e5f-7ace-4041-b0e4-e486420efb29 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:27.256828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79730e5f-7ace-4041-b0e4-e486420efb29 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:27.257612 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79730e5f-7ace-4041-b0e4-e486420efb29 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:27.258885 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79730e5f-7ace-4041-b0e4-e486420efb29 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:27.259710 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79730e5f-7ace-4041-b0e4-e486420efb29 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:27.623724 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-57cf5ad3-40f6-4330-a17e-b22915dda5f7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:27.625194 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-57cf5ad3-40f6-4330-a17e-b22915dda5f7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:27.642045 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-57cf5ad3-40f6-4330-a17e-b22915dda5f7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:27.643070 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-57cf5ad3-40f6-4330-a17e-b22915dda5f7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:27.645158 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-57cf5ad3-40f6-4330-a17e-b22915dda5f7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:27.646049 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-57cf5ad3-40f6-4330-a17e-b22915dda5f7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:28.285305 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-79730e5f-7ace-4041-b0e4-e486420efb29 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:28.296608 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-79730e5f-7ace-4041-b0e4-e486420efb29 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 200 len: 1515 microversion: 2.1 time: 1.060169 Apr 20 18:36:28.297619 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 349/703] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:27 2021] GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 1515 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:29.319538 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d2a2e231-8e37-4c4e-b06e-140f75f2ebf7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:29.320740 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d2a2e231-8e37-4c4e-b06e-140f75f2ebf7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:29.342552 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d2a2e231-8e37-4c4e-b06e-140f75f2ebf7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:29.345499 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d2a2e231-8e37-4c4e-b06e-140f75f2ebf7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:29.348508 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d2a2e231-8e37-4c4e-b06e-140f75f2ebf7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:29.349900 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d2a2e231-8e37-4c4e-b06e-140f75f2ebf7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:29.530993 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-57cf5ad3-40f6-4330-a17e-b22915dda5f7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:29.546315 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-57cf5ad3-40f6-4330-a17e-b22915dda5f7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1663 microversion: 2.1 time: 1.930632 Apr 20 18:36:29.546971 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 355/704] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:27 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1663 bytes in 1933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:29.781585 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d2a2e231-8e37-4c4e-b06e-140f75f2ebf7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:29.802669 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d2a2e231-8e37-4c4e-b06e-140f75f2ebf7 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 200 len: 1515 microversion: 2.1 time: 0.489941 Apr 20 18:36:29.804449 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 350/705] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:29 2021] GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 1515 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:36:30.575921 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3c97e128-7ca1-47aa-8d97-3d1cbd9d4f3a tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:30.580368 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3c97e128-7ca1-47aa-8d97-3d1cbd9d4f3a tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:30.602381 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c97e128-7ca1-47aa-8d97-3d1cbd9d4f3a tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:30.603754 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c97e128-7ca1-47aa-8d97-3d1cbd9d4f3a tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:30.606009 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c97e128-7ca1-47aa-8d97-3d1cbd9d4f3a tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:30.607230 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c97e128-7ca1-47aa-8d97-3d1cbd9d4f3a tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:30.644734 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-9a685ba0-9349-46ff-b0c3-d42c2d669c5c req-0d83c4ef-e9fb-496b-b809-2d0f96cacdf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "297d64ba-9465-41f0-8806-f19d3ad6b716", "name": "network-vif-deleted", "tag": "72140066-865c-41ce-87d7-1a043a14cb33"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:36:30.647884 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:36:30.647884 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:36:30.664213 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-9a685ba0-9349-46ff-b0c3-d42c2d669c5c req-0d83c4ef-e9fb-496b-b809-2d0f96cacdf5 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:30.665696 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-9a685ba0-9349-46ff-b0c3-d42c2d669c5c req-0d83c4ef-e9fb-496b-b809-2d0f96cacdf5 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:30.694481 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-9a685ba0-9349-46ff-b0c3-d42c2d669c5c req-0d83c4ef-e9fb-496b-b809-2d0f96cacdf5 service nova] Creating event network-vif-deleted:72140066-865c-41ce-87d7-1a043a14cb33 for instance 297d64ba-9465-41f0-8806-f19d3ad6b716 on hv-cinder-78693 Apr 20 18:36:30.709925 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-9a685ba0-9349-46ff-b0c3-d42c2d669c5c req-0d83c4ef-e9fb-496b-b809-2d0f96cacdf5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068320 Apr 20 18:36:30.712061 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 351/706] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:36:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:36:30.839120 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-92f310e3-f21d-470e-8af3-f6911cbd6455 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:30.840662 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-92f310e3-f21d-470e-8af3-f6911cbd6455 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:30.851484 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-92f310e3-f21d-470e-8af3-f6911cbd6455 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:30.852675 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-92f310e3-f21d-470e-8af3-f6911cbd6455 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:30.854313 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-92f310e3-f21d-470e-8af3-f6911cbd6455 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:30.855670 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-92f310e3-f21d-470e-8af3-f6911cbd6455 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:30.991828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-92f310e3-f21d-470e-8af3-f6911cbd6455 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:31.007708 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-92f310e3-f21d-470e-8af3-f6911cbd6455 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:31.008409 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-92f310e3-f21d-470e-8af3-f6911cbd6455 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lazy-loading 'fault' on Instance uuid 297d64ba-9465-41f0-8806-f19d3ad6b716 {{(pid=100593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:36:31.082428 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3c97e128-7ca1-47aa-8d97-3d1cbd9d4f3a tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:31.093310 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3c97e128-7ca1-47aa-8d97-3d1cbd9d4f3a tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1667 microversion: 2.1 time: 0.529990 Apr 20 18:36:31.094025 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 356/707] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:30 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1667 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:31.163166 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-92f310e3-f21d-470e-8af3-f6911cbd6455 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6127e7600b4ec9beae1e0ce6241f60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c036c284f0be4d2d8e070be841f52d9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:36:31.178798 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-92f310e3-f21d-470e-8af3-f6911cbd6455 tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 200 len: 1309 microversion: 2.1 time: 0.348730 Apr 20 18:36:31.179730 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 352/708] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:30 2021] GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 1309 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:36:32.198796 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b48e4996-61dc-4aed-9bde-95ec8bea7ceb tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:36:32.199459 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b48e4996-61dc-4aed-9bde-95ec8bea7ceb tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] [instance: 297d64ba-9465-41f0-8806-f19d3ad6b716] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:36:32.209304 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b48e4996-61dc-4aed-9bde-95ec8bea7ceb tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:32.210177 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b48e4996-61dc-4aed-9bde-95ec8bea7ceb tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:32.211062 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b48e4996-61dc-4aed-9bde-95ec8bea7ceb tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:36:32.211661 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b48e4996-61dc-4aed-9bde-95ec8bea7ceb tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:36:32.272009 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-b48e4996-61dc-4aed-9bde-95ec8bea7ceb tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] HTTP exception thrown: Instance 297d64ba-9465-41f0-8806-f19d3ad6b716 could not be found. Apr 20 18:36:32.272681 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b48e4996-61dc-4aed-9bde-95ec8bea7ceb tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] Returning 404 to user: Instance 297d64ba-9465-41f0-8806-f19d3ad6b716 could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:36:32.273658 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b48e4996-61dc-4aed-9bde-95ec8bea7ceb tempest-VolumesSnapshotTestJSON-1195516248 tempest-VolumesSnapshotTestJSON-1195516248-project] 10.222.0.25 "GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716" status: 404 len: 111 microversion: 2.1 time: 0.079236 Apr 20 18:36:32.278343 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 357/709] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:36:32 2021] GET /compute/v2.1/servers/297d64ba-9465-41f0-8806-f19d3ad6b716 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:37:08.570233 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-af4a8ec2-208f-46e4-b271-67211779dfa0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:08.571406 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-af4a8ec2-208f-46e4-b271-67211779dfa0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:08.581166 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-af4a8ec2-208f-46e4-b271-67211779dfa0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:08.583868 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-af4a8ec2-208f-46e4-b271-67211779dfa0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:08.585204 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-af4a8ec2-208f-46e4-b271-67211779dfa0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:08.585920 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-af4a8ec2-208f-46e4-b271-67211779dfa0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:08.671266 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-af4a8ec2-208f-46e4-b271-67211779dfa0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/os-volume_attachments/772cc194-ad1f-4ef2-981d-0e5b23c87312" status: 200 len: 194 microversion: 2.20 time: 0.348151 Apr 20 18:37:08.678702 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 353/710] 10.222.0.25 () {60 vars in 1444 bytes} [Tue Apr 20 18:37:08 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/os-volume_attachments/772cc194-ad1f-4ef2-981d-0e5b23c87312 => generated 194 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:37:08.885076 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-97cbd672-110e-472a-ac12-c2e12c2af275 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:08.885855 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-97cbd672-110e-472a-ac12-c2e12c2af275 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:08.898569 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-97cbd672-110e-472a-ac12-c2e12c2af275 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:08.899637 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-97cbd672-110e-472a-ac12-c2e12c2af275 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:08.900746 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-97cbd672-110e-472a-ac12-c2e12c2af275 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:08.901510 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-97cbd672-110e-472a-ac12-c2e12c2af275 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:09.185587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-97cbd672-110e-472a-ac12-c2e12c2af275 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lazy-loading 'services' on Instance uuid 1e532f85-bed6-43d3-969d-3a2688b4638b {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:37:09.415632 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-97cbd672-110e-472a-ac12-c2e12c2af275 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/os-volume_attachments/772cc194-ad1f-4ef2-981d-0e5b23c87312" status: 202 len: 0 microversion: 2.20 time: 0.534598 Apr 20 18:37:09.416890 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 358/711] 10.222.0.25 () {60 vars in 1447 bytes} [Tue Apr 20 18:37:08 2021] DELETE /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b/os-volume_attachments/772cc194-ad1f-4ef2-981d-0e5b23c87312 => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:37:10.361958 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-cc5b5d16-f80f-4292-bd88-652553de752b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:10.362676 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-cc5b5d16-f80f-4292-bd88-652553de752b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:10.417593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cc5b5d16-f80f-4292-bd88-652553de752b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:10.418106 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cc5b5d16-f80f-4292-bd88-652553de752b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:10.418981 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cc5b5d16-f80f-4292-bd88-652553de752b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:10.419475 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cc5b5d16-f80f-4292-bd88-652553de752b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:10.520077 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-cc5b5d16-f80f-4292-bd88-652553de752b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Going to try to terminate instance {{(pid=100593) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:37:10.755547 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-cc5b5d16-f80f-4292-bd88-652553de752b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 204 len: 0 microversion: 2.1 time: 0.397385 Apr 20 18:37:10.756310 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 354/712] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:37:10 2021] DELETE /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:37:10.766985 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-239d5410-840e-4ea3-86d9-bb4416296609 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:10.769251 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-239d5410-840e-4ea3-86d9-bb4416296609 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:10.801815 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-239d5410-840e-4ea3-86d9-bb4416296609 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:10.802336 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-239d5410-840e-4ea3-86d9-bb4416296609 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:10.803221 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-239d5410-840e-4ea3-86d9-bb4416296609 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:10.803731 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-239d5410-840e-4ea3-86d9-bb4416296609 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:11.048912 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c9a385f2-d03a-41c3-99f7-f57ba6d58a02 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:11.050731 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c9a385f2-d03a-41c3-99f7-f57ba6d58a02 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:11.070009 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c9a385f2-d03a-41c3-99f7-f57ba6d58a02 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:11.070906 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c9a385f2-d03a-41c3-99f7-f57ba6d58a02 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:11.072287 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c9a385f2-d03a-41c3-99f7-f57ba6d58a02 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:11.073474 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c9a385f2-d03a-41c3-99f7-f57ba6d58a02 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:11.248796 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c9a385f2-d03a-41c3-99f7-f57ba6d58a02 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Going to try to terminate instance {{(pid=100593) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:37:11.499889 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c9a385f2-d03a-41c3-99f7-f57ba6d58a02 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 204 len: 0 microversion: 2.20 time: 0.451418 Apr 20 18:37:11.505614 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 355/713] 10.222.0.25 () {60 vars in 1270 bytes} [Tue Apr 20 18:37:11 2021] DELETE /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 18:37:11.512548 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8dc9c554-9754-435f-a42c-6460349bf61f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:11.513832 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8dc9c554-9754-435f-a42c-6460349bf61f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:11.523566 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8dc9c554-9754-435f-a42c-6460349bf61f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:11.524410 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8dc9c554-9754-435f-a42c-6460349bf61f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:11.525647 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8dc9c554-9754-435f-a42c-6460349bf61f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:11.526472 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8dc9c554-9754-435f-a42c-6460349bf61f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:11.669982 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-239d5410-840e-4ea3-86d9-bb4416296609 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:11.682410 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-239d5410-840e-4ea3-86d9-bb4416296609 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1673 microversion: 2.1 time: 0.920973 Apr 20 18:37:11.684789 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 359/714] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:10 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1673 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:12.002111 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8dc9c554-9754-435f-a42c-6460349bf61f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:12.021562 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8dc9c554-9754-435f-a42c-6460349bf61f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:12.024605 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8dc9c554-9754-435f-a42c-6460349bf61f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:12.026182 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8dc9c554-9754-435f-a42c-6460349bf61f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.518910 Apr 20 18:37:12.027489 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 356/715] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:37:11 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:37:12.706608 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-cff93efe-da48-4b61-876d-d2503f8d78ea tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:12.708027 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-cff93efe-da48-4b61-876d-d2503f8d78ea tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:12.718548 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cff93efe-da48-4b61-876d-d2503f8d78ea tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:12.719440 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cff93efe-da48-4b61-876d-d2503f8d78ea tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:12.720550 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cff93efe-da48-4b61-876d-d2503f8d78ea tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:12.721288 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cff93efe-da48-4b61-876d-d2503f8d78ea tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:13.046889 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7bbc05d5-8586-41aa-b105-b0519ea405a8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:13.047572 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7bbc05d5-8586-41aa-b105-b0519ea405a8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:13.075441 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7bbc05d5-8586-41aa-b105-b0519ea405a8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:13.075963 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7bbc05d5-8586-41aa-b105-b0519ea405a8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:13.076843 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7bbc05d5-8586-41aa-b105-b0519ea405a8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:13.077346 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7bbc05d5-8586-41aa-b105-b0519ea405a8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:13.470348 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-cff93efe-da48-4b61-876d-d2503f8d78ea tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:13.485155 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-cff93efe-da48-4b61-876d-d2503f8d78ea tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1673 microversion: 2.1 time: 0.783982 Apr 20 18:37:13.489895 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 360/716] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:12 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1673 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:13.591745 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7bbc05d5-8586-41aa-b105-b0519ea405a8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:13.602334 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7bbc05d5-8586-41aa-b105-b0519ea405a8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:13.604879 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7bbc05d5-8586-41aa-b105-b0519ea405a8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:13.605920 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7bbc05d5-8586-41aa-b105-b0519ea405a8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.563283 Apr 20 18:37:13.606624 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 357/717] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:37:13 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:37:14.511968 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-af1146fd-0a98-484b-bdd8-a93a66993d56 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:14.513367 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-af1146fd-0a98-484b-bdd8-a93a66993d56 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:14.542786 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-af1146fd-0a98-484b-bdd8-a93a66993d56 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:14.545887 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-af1146fd-0a98-484b-bdd8-a93a66993d56 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:14.548974 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-af1146fd-0a98-484b-bdd8-a93a66993d56 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:14.552420 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-af1146fd-0a98-484b-bdd8-a93a66993d56 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:14.626759 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-79875da6-6492-454a-bec0-23abe4791d88 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:14.628384 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-79875da6-6492-454a-bec0-23abe4791d88 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:14.649077 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79875da6-6492-454a-bec0-23abe4791d88 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:14.649911 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79875da6-6492-454a-bec0-23abe4791d88 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:14.651876 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79875da6-6492-454a-bec0-23abe4791d88 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:14.653048 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-79875da6-6492-454a-bec0-23abe4791d88 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:15.612535 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-79875da6-6492-454a-bec0-23abe4791d88 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:15.648704 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-79875da6-6492-454a-bec0-23abe4791d88 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:15.666543 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-79875da6-6492-454a-bec0-23abe4791d88 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:15.672281 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-79875da6-6492-454a-bec0-23abe4791d88 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 1.047256 Apr 20 18:37:15.673889 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 358/718] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:37:14 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:37:16.184500 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-af1146fd-0a98-484b-bdd8-a93a66993d56 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:16.195494 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-af1146fd-0a98-484b-bdd8-a93a66993d56 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1673 microversion: 2.1 time: 1.690128 Apr 20 18:37:16.196088 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 361/719] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:14 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1673 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:16.701115 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-14edbdeb-7efa-4576-be0e-9b4274edd695 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:16.701946 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-14edbdeb-7efa-4576-be0e-9b4274edd695 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:16.730387 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-14edbdeb-7efa-4576-be0e-9b4274edd695 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:16.730843 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-14edbdeb-7efa-4576-be0e-9b4274edd695 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:16.731715 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-14edbdeb-7efa-4576-be0e-9b4274edd695 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:16.732179 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-14edbdeb-7efa-4576-be0e-9b4274edd695 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:17.215026 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a1256359-4d57-4126-bf93-e2149a37e692 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:17.215995 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a1256359-4d57-4126-bf93-e2149a37e692 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:17.240395 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a1256359-4d57-4126-bf93-e2149a37e692 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:17.244112 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a1256359-4d57-4126-bf93-e2149a37e692 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:17.245949 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a1256359-4d57-4126-bf93-e2149a37e692 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:17.246711 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a1256359-4d57-4126-bf93-e2149a37e692 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:17.679552 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-14edbdeb-7efa-4576-be0e-9b4274edd695 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:17.692636 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-14edbdeb-7efa-4576-be0e-9b4274edd695 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:17.694389 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-14edbdeb-7efa-4576-be0e-9b4274edd695 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:17.699299 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-14edbdeb-7efa-4576-be0e-9b4274edd695 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 1.002654 Apr 20 18:37:17.700060 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 359/720] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:37:16 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:37:17.856684 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-912901a9-6680-4688-bdac-d15ef499c328 req-9ffee6ef-c6e6-4531-a634-f7e3ea11415a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e532f85-bed6-43d3-969d-3a2688b4638b", "name": "network-vif-unplugged", "status": "completed", "tag": "36707b77-0efd-41e0-9dc6-6332c175126e"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:37:17.858731 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:37:17.858731 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:37:17.884017 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-912901a9-6680-4688-bdac-d15ef499c328 req-9ffee6ef-c6e6-4531-a634-f7e3ea11415a service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:17.884526 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-912901a9-6680-4688-bdac-d15ef499c328 req-9ffee6ef-c6e6-4531-a634-f7e3ea11415a service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:17.915786 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-912901a9-6680-4688-bdac-d15ef499c328 req-9ffee6ef-c6e6-4531-a634-f7e3ea11415a service nova] Creating event network-vif-unplugged:36707b77-0efd-41e0-9dc6-6332c175126e for instance 1e532f85-bed6-43d3-969d-3a2688b4638b on hv-cinder-78693 Apr 20 18:37:17.925577 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-912901a9-6680-4688-bdac-d15ef499c328 req-9ffee6ef-c6e6-4531-a634-f7e3ea11415a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.223630 Apr 20 18:37:17.926900 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 360/721] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:37:17 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:37:18.547516 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a1256359-4d57-4126-bf93-e2149a37e692 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:18.560479 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a1256359-4d57-4126-bf93-e2149a37e692 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1673 microversion: 2.1 time: 1.349714 Apr 20 18:37:18.570011 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 362/722] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:17 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1673 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:18.720911 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-fad2ed62-4fe3-4062-92a2-6995425a004c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:18.721927 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-fad2ed62-4fe3-4062-92a2-6995425a004c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:18.741128 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fad2ed62-4fe3-4062-92a2-6995425a004c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:18.741698 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fad2ed62-4fe3-4062-92a2-6995425a004c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:18.742565 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fad2ed62-4fe3-4062-92a2-6995425a004c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:18.747579 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fad2ed62-4fe3-4062-92a2-6995425a004c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:19.526900 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-64d06127-3596-47f8-8e15-007c690639fa req-395c2d78-8a4d-4cdf-8d7a-fb1e41a886d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b71640b-07ee-4677-8477-21da0a4166b1", "name": "network-vif-deleted", "tag": "b561ce74-34d1-41ad-9000-53f8fd556887"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:37:19.542301 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:37:19.542301 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:37:19.580469 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-64d06127-3596-47f8-8e15-007c690639fa req-395c2d78-8a4d-4cdf-8d7a-fb1e41a886d1 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:19.582876 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-64d06127-3596-47f8-8e15-007c690639fa req-395c2d78-8a4d-4cdf-8d7a-fb1e41a886d1 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:19.594355 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-fad2ed62-4fe3-4062-92a2-6995425a004c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:19.609928 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-fad2ed62-4fe3-4062-92a2-6995425a004c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:19.612884 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-fad2ed62-4fe3-4062-92a2-6995425a004c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:19.617007 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-fad2ed62-4fe3-4062-92a2-6995425a004c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 0.901163 Apr 20 18:37:19.618637 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 361/723] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:37:18 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:37:19.632176 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6d88d4fa-6003-4b2a-9cc9-a2f68588b745 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:19.635482 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6d88d4fa-6003-4b2a-9cc9-a2f68588b745 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:19.647186 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-64d06127-3596-47f8-8e15-007c690639fa req-395c2d78-8a4d-4cdf-8d7a-fb1e41a886d1 service nova] Creating event network-vif-deleted:b561ce74-34d1-41ad-9000-53f8fd556887 for instance 3b71640b-07ee-4677-8477-21da0a4166b1 on hv-cinder-78693 Apr 20 18:37:19.661577 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-64d06127-3596-47f8-8e15-007c690639fa req-395c2d78-8a4d-4cdf-8d7a-fb1e41a886d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.306562 Apr 20 18:37:19.664549 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 363/724] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:37:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:37:19.665541 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6d88d4fa-6003-4b2a-9cc9-a2f68588b745 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:19.666261 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6d88d4fa-6003-4b2a-9cc9-a2f68588b745 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:19.667993 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6d88d4fa-6003-4b2a-9cc9-a2f68588b745 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:19.670229 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6d88d4fa-6003-4b2a-9cc9-a2f68588b745 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:19.786472 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6d88d4fa-6003-4b2a-9cc9-a2f68588b745 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:19.787271 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6d88d4fa-6003-4b2a-9cc9-a2f68588b745 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:19.788269 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-6d88d4fa-6003-4b2a-9cc9-a2f68588b745 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lazy-loading 'fault' on Instance uuid 3b71640b-07ee-4677-8477-21da0a4166b1 {{(pid=100593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:37:20.059416 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6d88d4fa-6003-4b2a-9cc9-a2f68588b745 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:20.072011 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6d88d4fa-6003-4b2a-9cc9-a2f68588b745 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 200 len: 1327 microversion: 2.1 time: 0.449379 Apr 20 18:37:20.086969 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 362/725] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:19 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 1327 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:20.657669 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5cd181e1-0010-4688-b81d-e039eef39ea1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:20.659206 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5cd181e1-0010-4688-b81d-e039eef39ea1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:20.709268 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5cd181e1-0010-4688-b81d-e039eef39ea1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:20.714263 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5cd181e1-0010-4688-b81d-e039eef39ea1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:20.715967 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5cd181e1-0010-4688-b81d-e039eef39ea1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:20.717332 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5cd181e1-0010-4688-b81d-e039eef39ea1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:21.096475 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5a7f5a6d-e07f-4f58-9152-f75baf8da099 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:21.097544 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5a7f5a6d-e07f-4f58-9152-f75baf8da099 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:21.179629 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a7f5a6d-e07f-4f58-9152-f75baf8da099 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:21.181176 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a7f5a6d-e07f-4f58-9152-f75baf8da099 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:21.183231 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a7f5a6d-e07f-4f58-9152-f75baf8da099 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:21.184435 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a7f5a6d-e07f-4f58-9152-f75baf8da099 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:21.477663 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-5a7f5a6d-e07f-4f58-9152-f75baf8da099 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] HTTP exception thrown: Instance 3b71640b-07ee-4677-8477-21da0a4166b1 could not be found. Apr 20 18:37:21.485350 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5a7f5a6d-e07f-4f58-9152-f75baf8da099 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Returning 404 to user: Instance 3b71640b-07ee-4677-8477-21da0a4166b1 could not be found. {{(pid=100593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:37:21.490796 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5a7f5a6d-e07f-4f58-9152-f75baf8da099 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 404 len: 111 microversion: 2.1 time: 0.402265 Apr 20 18:37:21.512545 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 363/726] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:21 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 111 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:37:21.547173 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a3dc1624-0268-4174-a5c9-bbcc3b30f5e3 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '.version_select at 0x7f418cda2510>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:21.633798 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a3dc1624-0268-4174-a5c9-bbcc3b30f5e3 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1725491342" status: 202 len: 0 microversion: 2.1 time: 0.109991 Apr 20 18:37:21.634706 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 364/727] 10.222.0.25 () {58 vars in 1211 bytes} [Tue Apr 20 18:37:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1725491342 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:37:23.319318 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5cd181e1-0010-4688-b81d-e039eef39ea1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:23.338637 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5cd181e1-0010-4688-b81d-e039eef39ea1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:23.345507 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5cd181e1-0010-4688-b81d-e039eef39ea1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:23.347393 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5cd181e1-0010-4688-b81d-e039eef39ea1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1722 microversion: 2.20 time: 2.703156 Apr 20 18:37:23.348456 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 364/728] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:37:20 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1722 bytes in 2707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:37:24.368255 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-bebd268a-c349-41e4-b04e-3250180920f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:24.368915 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-bebd268a-c349-41e4-b04e-3250180920f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:24.424299 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bebd268a-c349-41e4-b04e-3250180920f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:24.424817 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bebd268a-c349-41e4-b04e-3250180920f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:24.425944 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bebd268a-c349-41e4-b04e-3250180920f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:24.426317 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bebd268a-c349-41e4-b04e-3250180920f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:25.040647 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-bebd268a-c349-41e4-b04e-3250180920f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:25.069870 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-bebd268a-c349-41e4-b04e-3250180920f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:25.074836 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-bebd268a-c349-41e4-b04e-3250180920f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:25.076136 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-bebd268a-c349-41e4-b04e-3250180920f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1654 microversion: 2.20 time: 0.712144 Apr 20 18:37:25.076755 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 365/729] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:37:24 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1654 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:37:25.126840 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c2db7471-7366-4b8d-8720-1d1da1aea9be tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'create', calling method: .version_select at 0x7f418d836158>, body: {"keypair": {"name": "tempest-keypair-573190554"}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:37:25.159402 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-c2db7471-7366-4b8d-8720-1d1da1aea9be tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Getting quotas for project 379c1b40340b46408792cb7d852bbba7. Resources: {'key_pairs'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:37:25.165903 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-c2db7471-7366-4b8d-8720-1d1da1aea9be tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Getting quotas for user 61a26e5925ce4f50ab72f8d18670edd6 and project 379c1b40340b46408792cb7d852bbba7. Resources: {'key_pairs'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:37:25.867054 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-c2db7471-7366-4b8d-8720-1d1da1aea9be tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Getting quotas for project 379c1b40340b46408792cb7d852bbba7. Resources: {'key_pairs'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:37:25.879287 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-c2db7471-7366-4b8d-8720-1d1da1aea9be tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Getting quotas for user 61a26e5925ce4f50ab72f8d18670edd6 and project 379c1b40340b46408792cb7d852bbba7. Resources: {'key_pairs'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:37:25.907705 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c2db7471-7366-4b8d-8720-1d1da1aea9be tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.790847 Apr 20 18:37:25.910236 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 365/730] 10.222.0.25 () {60 vars in 1148 bytes} [Tue Apr 20 18:37:25 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:26.110386 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-567a8047-ca14-42a4-bcf2-9238e9784e24 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:26.111201 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-567a8047-ca14-42a4-bcf2-9238e9784e24 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:26.143748 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-567a8047-ca14-42a4-bcf2-9238e9784e24 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:26.144265 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-567a8047-ca14-42a4-bcf2-9238e9784e24 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:26.145131 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-567a8047-ca14-42a4-bcf2-9238e9784e24 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:26.145656 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-567a8047-ca14-42a4-bcf2-9238e9784e24 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:26.542635 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-567a8047-ca14-42a4-bcf2-9238e9784e24 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:26.564076 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-567a8047-ca14-42a4-bcf2-9238e9784e24 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:26.567043 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-567a8047-ca14-42a4-bcf2-9238e9784e24 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:26.573300 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-567a8047-ca14-42a4-bcf2-9238e9784e24 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1654 microversion: 2.20 time: 0.469548 Apr 20 18:37:26.574620 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 366/731] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:37:26 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1654 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:37:26.592568 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-dcdd30c7-8b1f-4038-b8a7-285e4cc272b2 req-5da6eedd-c4d0-4045-b897-e5206bb75655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e532f85-bed6-43d3-969d-3a2688b4638b", "name": "network-vif-deleted", "tag": "36707b77-0efd-41e0-9dc6-6332c175126e"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:37:26.594400 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:37:26.594400 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:37:26.606855 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-dcdd30c7-8b1f-4038-b8a7-285e4cc272b2 req-5da6eedd-c4d0-4045-b897-e5206bb75655 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:26.607771 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-dcdd30c7-8b1f-4038-b8a7-285e4cc272b2 req-5da6eedd-c4d0-4045-b897-e5206bb75655 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:26.629973 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-dcdd30c7-8b1f-4038-b8a7-285e4cc272b2 req-5da6eedd-c4d0-4045-b897-e5206bb75655 service nova] Creating event network-vif-deleted:36707b77-0efd-41e0-9dc6-6332c175126e for instance 1e532f85-bed6-43d3-969d-3a2688b4638b on hv-cinder-78693 Apr 20 18:37:26.635659 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-dcdd30c7-8b1f-4038-b8a7-285e4cc272b2 req-5da6eedd-c4d0-4045-b897-e5206bb75655 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047063 Apr 20 18:37:26.636943 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 366/732] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:37:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:37:27.594258 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-82694302-36e2-4d08-83b0-058c59d686cf tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:27.596216 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-82694302-36e2-4d08-83b0-058c59d686cf tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:27.614383 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-82694302-36e2-4d08-83b0-058c59d686cf tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:27.615181 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-82694302-36e2-4d08-83b0-058c59d686cf tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:27.616336 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-82694302-36e2-4d08-83b0-058c59d686cf tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:27.616979 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-82694302-36e2-4d08-83b0-058c59d686cf tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:28.715350 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-82694302-36e2-4d08-83b0-058c59d686cf tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:28.732561 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-82694302-36e2-4d08-83b0-058c59d686cf tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:28.739215 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-82694302-36e2-4d08-83b0-058c59d686cf tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:28.743163 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-82694302-36e2-4d08-83b0-058c59d686cf tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 200 len: 1654 microversion: 2.20 time: 1.153244 Apr 20 18:37:28.746414 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 367/733] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:37:27 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 1654 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:37:29.782090 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-59dd6249-2ce4-4c44-aa41-2485a8ed7efa tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:29.785427 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-59dd6249-2ce4-4c44-aa41-2485a8ed7efa tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:29.816804 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-59dd6249-2ce4-4c44-aa41-2485a8ed7efa tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:29.819373 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-59dd6249-2ce4-4c44-aa41-2485a8ed7efa tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:29.840816 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-59dd6249-2ce4-4c44-aa41-2485a8ed7efa tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:29.842165 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-59dd6249-2ce4-4c44-aa41-2485a8ed7efa tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:29.976268 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-59dd6249-2ce4-4c44-aa41-2485a8ed7efa tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] HTTP exception thrown: Instance 1e532f85-bed6-43d3-969d-3a2688b4638b could not be found. Apr 20 18:37:29.976959 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-59dd6249-2ce4-4c44-aa41-2485a8ed7efa tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Returning 404 to user: Instance 1e532f85-bed6-43d3-969d-3a2688b4638b could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:37:29.977947 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-59dd6249-2ce4-4c44-aa41-2485a8ed7efa tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 404 len: 111 microversion: 2.20 time: 0.210552 Apr 20 18:37:29.988711 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1c9189f2-a6ae-494f-a6d4-26669607ffb0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '.version_select at 0x7f418e278c80>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:29.993417 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 367/734] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:37:29 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 111 bytes in 228 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:37:30.015099 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1c9189f2-a6ae-494f-a6d4-26669607ffb0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1572287718" status: 204 len: 0 microversion: 2.20 time: 0.030959 Apr 20 18:37:30.016067 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 368/735] 10.222.0.25 () {60 vars in 1252 bytes} [Tue Apr 20 18:37:29 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1572287718 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 18:37:30.412992 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-cf1b3361-20ca-49db-8e93-4aa02d519ca7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-64419121", "imageRef": "ba8326d8-5d1b-42a2-a65e-f1108a025e30", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d598126-4968-4ab9-864c-ac1f0ffd6a08"}], "security_groups": [{"name": "tempest-securitygroup--1110966844"}], "key_name": "tempest-keypair-573190554", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:37:30.849641 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.network.neutron [None req-cf1b3361-20ca-49db-8e93-4aa02d519ca7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] validate_networks() for [('6d598126-4968-4ab9-864c-ac1f0ffd6a08', None, None, None)] {{(pid=100592) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:37:33.008841 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-fdafd232-d0ff-416a-9d97-46752bb8a1c4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'create', calling method: .version_select at 0x7f418cda2378>, body: {"keypair": {"name": "tempest-keypair-284959789"}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:37:33.116557 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-fdafd232-d0ff-416a-9d97-46752bb8a1c4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Getting quotas for project 39f3f26f55524d2d89d7c9cd7f9548f1. Resources: {'key_pairs'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:37:33.145015 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-fdafd232-d0ff-416a-9d97-46752bb8a1c4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Getting quotas for user 6bc02f4b196a44a5abb1843ae0b099bf and project 39f3f26f55524d2d89d7c9cd7f9548f1. Resources: {'key_pairs'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:37:33.338774 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-fdafd232-d0ff-416a-9d97-46752bb8a1c4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Getting quotas for project 39f3f26f55524d2d89d7c9cd7f9548f1. Resources: {'key_pairs'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:37:33.349884 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-fdafd232-d0ff-416a-9d97-46752bb8a1c4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Getting quotas for user 6bc02f4b196a44a5abb1843ae0b099bf and project 39f3f26f55524d2d89d7c9cd7f9548f1. Resources: {'key_pairs'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:37:33.383043 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-fdafd232-d0ff-416a-9d97-46752bb8a1c4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.394174 Apr 20 18:37:33.384374 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 369/736] 10.222.0.25 () {62 vars in 1189 bytes} [Tue Apr 20 18:37:32 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 398 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 20 18:37:34.834006 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-cf1b3361-20ca-49db-8e93-4aa02d519ca7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Flavor limits 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:37:34.834482 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-cf1b3361-20ca-49db-8e93-4aa02d519ca7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Image limits 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:37:34.834771 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-cf1b3361-20ca-49db-8e93-4aa02d519ca7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Flavor pref 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:37:34.835233 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-cf1b3361-20ca-49db-8e93-4aa02d519ca7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Image pref 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:37:34.835693 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-cf1b3361-20ca-49db-8e93-4aa02d519ca7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:37:34.862297 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cf1b3361-20ca-49db-8e93-4aa02d519ca7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:34.862775 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cf1b3361-20ca-49db-8e93-4aa02d519ca7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:34.866458 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cf1b3361-20ca-49db-8e93-4aa02d519ca7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:34.870587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cf1b3361-20ca-49db-8e93-4aa02d519ca7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:34.938482 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-cf1b3361-20ca-49db-8e93-4aa02d519ca7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Getting quotas for project 379c1b40340b46408792cb7d852bbba7. Resources: {'instances', 'ram', 'cores'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:37:34.960982 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-cf1b3361-20ca-49db-8e93-4aa02d519ca7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Getting quotas for user 61a26e5925ce4f50ab72f8d18670edd6 and project 379c1b40340b46408792cb7d852bbba7. Resources: {'instances', 'ram', 'cores'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:37:35.015322 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-cf1b3361-20ca-49db-8e93-4aa02d519ca7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Going to run 1 instances... {{(pid=100592) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:37:35.029544 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-cf1b3361-20ca-49db-8e93-4aa02d519ca7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba8326d8-5d1b-42a2-a65e-f1108a025e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100592) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:37:35.249710 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cf1b3361-20ca-49db-8e93-4aa02d519ca7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [6522e16b-97f7-40e9-b104-b22a2601df19] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 20 18:37:36.285519 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO oslo.messaging._drivers.impl_rabbit [None req-cf1b3361-20ca-49db-8e93-4aa02d519ca7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [6522e16b-97f7-40e9-b104-b22a2601df19] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 41696. Apr 20 18:37:36.293076 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-cf1b3361-20ca-49db-8e93-4aa02d519ca7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.927640 Apr 20 18:37:36.293797 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 368/737] 10.222.0.25 () {60 vars in 1137 bytes} [Tue Apr 20 18:37:30 2021] POST /compute/v2.1/servers => generated 402 bytes in 5930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:37:36.305859 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-998a9a2a-6afb-41dc-af27-96687aa9acfd tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:36.307101 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-998a9a2a-6afb-41dc-af27-96687aa9acfd tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:36.729779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-998a9a2a-6afb-41dc-af27-96687aa9acfd tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:36.763223 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-998a9a2a-6afb-41dc-af27-96687aa9acfd tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1235 microversion: 2.1 time: 0.448456 Apr 20 18:37:36.764334 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 370/738] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:36 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1235 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:37.806870 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9cda3081-e8a5-48d0-a7da-c0dcb3cd87c4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:37.808271 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9cda3081-e8a5-48d0-a7da-c0dcb3cd87c4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:38.272153 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9cda3081-e8a5-48d0-a7da-c0dcb3cd87c4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:38.287385 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9cda3081-e8a5-48d0-a7da-c0dcb3cd87c4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1235 microversion: 2.1 time: 0.484913 Apr 20 18:37:38.290142 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 369/739] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:37 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1235 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:38.339571 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-dd8302d6-3046-4716-973f-958174e4cb3c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-958361620", "imageRef": "ba8326d8-5d1b-42a2-a65e-f1108a025e30", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c318347e-9762-4bfc-b74e-1d0159deb3ef"}], "security_groups": [{"name": "tempest-securitygroup--1220413875"}], "key_name": "tempest-keypair-284959789", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:37:38.692692 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.network.neutron [None req-dd8302d6-3046-4716-973f-958174e4cb3c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] validate_networks() for [('c318347e-9762-4bfc-b74e-1d0159deb3ef', None, None, None)] {{(pid=100593) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:37:39.308607 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-47fee82a-7940-4d65-a0eb-ee8c8876ab0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:39.310266 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-47fee82a-7940-4d65-a0eb-ee8c8876ab0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:39.472746 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-47fee82a-7940-4d65-a0eb-ee8c8876ab0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:39.485123 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-47fee82a-7940-4d65-a0eb-ee8c8876ab0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1235 microversion: 2.1 time: 0.180805 Apr 20 18:37:39.493474 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 370/740] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:39 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1235 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:39.935497 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-eab50520-145b-4c39-8ccd-1b1f40e1d6c8 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Action: 'create', calling method: .version_select at 0x7f4196fc6e18>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1782040926"}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:37:40.012458 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-eab50520-145b-4c39-8ccd-1b1f40e1d6c8 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Getting quotas for project d38b0824b83f40c9874ffbc291951949. Resources: {'key_pairs'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:37:40.018206 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-eab50520-145b-4c39-8ccd-1b1f40e1d6c8 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Getting quotas for user 7a04013dbac84c5f93bdb7946e50d21d and project d38b0824b83f40c9874ffbc291951949. Resources: {'key_pairs'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:37:40.257069 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-dd8302d6-3046-4716-973f-958174e4cb3c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Flavor limits 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:37:40.257589 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-dd8302d6-3046-4716-973f-958174e4cb3c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Image limits 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:37:40.258681 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-dd8302d6-3046-4716-973f-958174e4cb3c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Flavor pref 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:37:40.259361 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-dd8302d6-3046-4716-973f-958174e4cb3c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Image pref 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:37:40.260041 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-dd8302d6-3046-4716-973f-958174e4cb3c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:37:40.271767 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dd8302d6-3046-4716-973f-958174e4cb3c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:40.272284 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dd8302d6-3046-4716-973f-958174e4cb3c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:40.273557 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dd8302d6-3046-4716-973f-958174e4cb3c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:40.274289 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dd8302d6-3046-4716-973f-958174e4cb3c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:40.303149 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-dd8302d6-3046-4716-973f-958174e4cb3c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Getting quotas for project 39f3f26f55524d2d89d7c9cd7f9548f1. Resources: {'instances', 'ram', 'cores'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:37:40.308680 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-dd8302d6-3046-4716-973f-958174e4cb3c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Getting quotas for user 6bc02f4b196a44a5abb1843ae0b099bf and project 39f3f26f55524d2d89d7c9cd7f9548f1. Resources: {'instances', 'ram', 'cores'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:37:40.320256 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-eab50520-145b-4c39-8ccd-1b1f40e1d6c8 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Getting quotas for project d38b0824b83f40c9874ffbc291951949. Resources: {'key_pairs'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:37:40.324337 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-dd8302d6-3046-4716-973f-958174e4cb3c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Going to run 1 instances... {{(pid=100593) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:37:40.327474 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-dd8302d6-3046-4716-973f-958174e4cb3c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba8326d8-5d1b-42a2-a65e-f1108a025e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:37:40.342460 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-eab50520-145b-4c39-8ccd-1b1f40e1d6c8 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Getting quotas for user 7a04013dbac84c5f93bdb7946e50d21d and project d38b0824b83f40c9874ffbc291951949. Resources: {'key_pairs'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:37:40.407527 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-eab50520-145b-4c39-8ccd-1b1f40e1d6c8 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.912452 Apr 20 18:37:40.409890 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 371/741] 10.222.0.25 () {60 vars in 1148 bytes} [Tue Apr 20 18:37:39 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:40.461245 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dd8302d6-3046-4716-973f-958174e4cb3c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [e002737e-e531-4e58-a8e3-5213b06e71ee] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 20 18:37:40.511875 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e4d7163d-563d-43cc-bcd6-2076ecca8037 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:40.520315 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e4d7163d-563d-43cc-bcd6-2076ecca8037 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:40.653429 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e4d7163d-563d-43cc-bcd6-2076ecca8037 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:40.667997 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e4d7163d-563d-43cc-bcd6-2076ecca8037 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1235 microversion: 2.1 time: 0.162427 Apr 20 18:37:40.669605 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 372/742] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:40 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1235 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:41.495506 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO oslo.messaging._drivers.impl_rabbit [None req-dd8302d6-3046-4716-973f-958174e4cb3c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [e002737e-e531-4e58-a8e3-5213b06e71ee] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 41800. Apr 20 18:37:41.513069 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-dd8302d6-3046-4716-973f-958174e4cb3c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.171700 Apr 20 18:37:41.519021 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 371/743] 10.222.0.25 () {62 vars in 1178 bytes} [Tue Apr 20 18:37:38 2021] POST /compute/v2.1/servers => generated 402 bytes in 3185 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 20 18:37:41.526606 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-47a2e59c-319b-41cb-87eb-056acd871026 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:41.527369 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-47a2e59c-319b-41cb-87eb-056acd871026 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:41.692907 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-cd46b3e4-c3cd-47e9-abef-67a559e025b9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:41.693942 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-cd46b3e4-c3cd-47e9-abef-67a559e025b9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:41.704498 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cd46b3e4-c3cd-47e9-abef-67a559e025b9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:41.706183 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cd46b3e4-c3cd-47e9-abef-67a559e025b9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:41.707338 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cd46b3e4-c3cd-47e9-abef-67a559e025b9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:41.708041 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cd46b3e4-c3cd-47e9-abef-67a559e025b9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:41.857910 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-47a2e59c-319b-41cb-87eb-056acd871026 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:41.872979 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-47a2e59c-319b-41cb-87eb-056acd871026 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:41.875279 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-47a2e59c-319b-41cb-87eb-056acd871026 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:41.877248 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-47a2e59c-319b-41cb-87eb-056acd871026 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1280 microversion: 2.20 time: 0.355094 Apr 20 18:37:41.890478 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 373/744] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:37:41 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1280 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:37:41.921365 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-cd46b3e4-c3cd-47e9-abef-67a559e025b9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:41.937718 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-cd46b3e4-c3cd-47e9-abef-67a559e025b9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1239 microversion: 2.1 time: 0.250053 Apr 20 18:37:41.938758 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 372/745] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:41 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1239 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:42.910158 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0a08f047-1b68-4eb9-a853-572d96bc39ff tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:42.911581 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0a08f047-1b68-4eb9-a853-572d96bc39ff tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:42.961950 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3be598d5-61b5-4498-9392-bd216e01f1ac tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:42.962871 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3be598d5-61b5-4498-9392-bd216e01f1ac tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:42.983022 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3be598d5-61b5-4498-9392-bd216e01f1ac tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:42.986702 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3be598d5-61b5-4498-9392-bd216e01f1ac tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:42.992108 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3be598d5-61b5-4498-9392-bd216e01f1ac tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:43.000103 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3be598d5-61b5-4498-9392-bd216e01f1ac tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:43.236855 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3be598d5-61b5-4498-9392-bd216e01f1ac tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:43.249807 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3be598d5-61b5-4498-9392-bd216e01f1ac tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1295 microversion: 2.1 time: 0.292403 Apr 20 18:37:43.253026 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 373/746] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:42 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1295 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:43.929621 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0a08f047-1b68-4eb9-a853-572d96bc39ff tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:43.989788 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0a08f047-1b68-4eb9-a853-572d96bc39ff tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:44.005082 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0a08f047-1b68-4eb9-a853-572d96bc39ff tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:44.007606 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0a08f047-1b68-4eb9-a853-572d96bc39ff tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1280 microversion: 2.20 time: 1.110767 Apr 20 18:37:44.027172 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 374/747] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:37:42 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1280 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:37:44.274829 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-78f2cc5c-b3fc-47ff-9f6f-8e8e7dc09a19 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:44.276133 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-78f2cc5c-b3fc-47ff-9f6f-8e8e7dc09a19 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:44.338242 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-78f2cc5c-b3fc-47ff-9f6f-8e8e7dc09a19 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:44.338773 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-78f2cc5c-b3fc-47ff-9f6f-8e8e7dc09a19 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:44.339672 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-78f2cc5c-b3fc-47ff-9f6f-8e8e7dc09a19 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:44.340315 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-78f2cc5c-b3fc-47ff-9f6f-8e8e7dc09a19 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:44.632128 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-78f2cc5c-b3fc-47ff-9f6f-8e8e7dc09a19 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:44.642380 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-78f2cc5c-b3fc-47ff-9f6f-8e8e7dc09a19 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1293 microversion: 2.1 time: 0.377217 Apr 20 18:37:44.643262 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 374/748] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:44 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1293 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:45.046977 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4b09e7bb-1b28-4d19-9ea2-0996e5713a4e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:45.047844 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4b09e7bb-1b28-4d19-9ea2-0996e5713a4e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:45.277613 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4b09e7bb-1b28-4d19-9ea2-0996e5713a4e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:45.290245 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4b09e7bb-1b28-4d19-9ea2-0996e5713a4e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:45.302050 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4b09e7bb-1b28-4d19-9ea2-0996e5713a4e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:45.303871 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4b09e7bb-1b28-4d19-9ea2-0996e5713a4e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1280 microversion: 2.20 time: 0.260764 Apr 20 18:37:45.305307 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 375/749] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:37:45 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1280 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:37:45.672555 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-02e0b478-1891-4299-ab38-f2c3bd1e6daf tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:45.673719 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-02e0b478-1891-4299-ab38-f2c3bd1e6daf tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:45.695453 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-02e0b478-1891-4299-ab38-f2c3bd1e6daf tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:45.696166 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-02e0b478-1891-4299-ab38-f2c3bd1e6daf tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:45.697240 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-02e0b478-1891-4299-ab38-f2c3bd1e6daf tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:45.697914 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-02e0b478-1891-4299-ab38-f2c3bd1e6daf tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:46.096037 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-02e0b478-1891-4299-ab38-f2c3bd1e6daf tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:46.105515 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-16984848-0b62-4d34-9b78-713115c3d941 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Action: 'create', calling method: .version_select at 0x7f4192222ae8>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-709334130"}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:37:46.116774 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-02e0b478-1891-4299-ab38-f2c3bd1e6daf tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1361 microversion: 2.1 time: 0.454011 Apr 20 18:37:46.132375 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 375/750] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:45 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1361 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:46.144725 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-16984848-0b62-4d34-9b78-713115c3d941 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Getting quotas for project e634dce05f2b45d593dfbca5940a886d. Resources: {'key_pairs'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:37:46.149285 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-16984848-0b62-4d34-9b78-713115c3d941 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Getting quotas for user fb4b8a040bad47f4994f810038c18ddb and project e634dce05f2b45d593dfbca5940a886d. Resources: {'key_pairs'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:37:46.324652 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ac241f5c-aeca-4769-a01c-aedf547c728b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:46.325316 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ac241f5c-aeca-4769-a01c-aedf547c728b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:46.335752 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ac241f5c-aeca-4769-a01c-aedf547c728b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:46.336563 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ac241f5c-aeca-4769-a01c-aedf547c728b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:46.343542 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ac241f5c-aeca-4769-a01c-aedf547c728b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:46.344406 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ac241f5c-aeca-4769-a01c-aedf547c728b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:46.605053 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-16984848-0b62-4d34-9b78-713115c3d941 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Getting quotas for project e634dce05f2b45d593dfbca5940a886d. Resources: {'key_pairs'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:37:46.621700 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-16984848-0b62-4d34-9b78-713115c3d941 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Getting quotas for user fb4b8a040bad47f4994f810038c18ddb and project e634dce05f2b45d593dfbca5940a886d. Resources: {'key_pairs'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:37:46.652800 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-16984848-0b62-4d34-9b78-713115c3d941 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.551527 Apr 20 18:37:46.653801 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 376/751] 10.222.0.25 () {60 vars in 1148 bytes} [Tue Apr 20 18:37:46 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:37:46.772648 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ac241f5c-aeca-4769-a01c-aedf547c728b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:46.789298 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ac241f5c-aeca-4769-a01c-aedf547c728b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:46.794544 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ac241f5c-aeca-4769-a01c-aedf547c728b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:46.799714 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ac241f5c-aeca-4769-a01c-aedf547c728b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1284 microversion: 2.20 time: 0.478973 Apr 20 18:37:46.802236 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 376/752] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:37:46 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1284 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:37:47.051021 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-edf07e6b-5fda-4cbd-9802-8ef0a693b952 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-860399417", "imageRef": "960a7e5d-8e47-44d2-9fdf-f05dad1c1662", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-709334130", "networks": [{"uuid": "969ebbf0-9525-4cc6-a8c8-e1e668e25185"}]}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:37:47.135455 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-72a45e2c-f03d-4ecf-bc31-2280bd0db606 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:47.136339 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-72a45e2c-f03d-4ecf-bc31-2280bd0db606 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:47.149177 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-72a45e2c-f03d-4ecf-bc31-2280bd0db606 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:47.156521 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-72a45e2c-f03d-4ecf-bc31-2280bd0db606 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:47.158177 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-72a45e2c-f03d-4ecf-bc31-2280bd0db606 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:47.158823 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-72a45e2c-f03d-4ecf-bc31-2280bd0db606 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:47.211301 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.network.neutron [None req-edf07e6b-5fda-4cbd-9802-8ef0a693b952 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] validate_networks() for [('969ebbf0-9525-4cc6-a8c8-e1e668e25185', None, None, None)] {{(pid=100592) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:37:47.506298 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-72a45e2c-f03d-4ecf-bc31-2280bd0db606 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:47.523894 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-72a45e2c-f03d-4ecf-bc31-2280bd0db606 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1361 microversion: 2.1 time: 0.393101 Apr 20 18:37:47.524672 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 377/753] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:47 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1361 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:47.825425 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-43fdf762-ca52-4011-ab6a-207174ce1430 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:47.826542 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-43fdf762-ca52-4011-ab6a-207174ce1430 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:47.834855 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-43fdf762-ca52-4011-ab6a-207174ce1430 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:47.835604 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-43fdf762-ca52-4011-ab6a-207174ce1430 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:47.836680 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-43fdf762-ca52-4011-ab6a-207174ce1430 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:47.837172 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-43fdf762-ca52-4011-ab6a-207174ce1430 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:47.987860 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-43fdf762-ca52-4011-ab6a-207174ce1430 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:48.007921 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-43fdf762-ca52-4011-ab6a-207174ce1430 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:48.010188 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-43fdf762-ca52-4011-ab6a-207174ce1430 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:48.011890 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-43fdf762-ca52-4011-ab6a-207174ce1430 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1338 microversion: 2.20 time: 0.195189 Apr 20 18:37:48.012730 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 378/754] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:37:47 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1338 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:37:48.551026 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-44951ac0-4871-4968-b48e-45955f38f613 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:48.552078 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-44951ac0-4871-4968-b48e-45955f38f613 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:48.569706 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-44951ac0-4871-4968-b48e-45955f38f613 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:48.570943 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-44951ac0-4871-4968-b48e-45955f38f613 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:48.573816 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-44951ac0-4871-4968-b48e-45955f38f613 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:48.574663 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-44951ac0-4871-4968-b48e-45955f38f613 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:49.154026 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-44951ac0-4871-4968-b48e-45955f38f613 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:49.166670 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-44951ac0-4871-4968-b48e-45955f38f613 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1361 microversion: 2.1 time: 0.624309 Apr 20 18:37:49.175498 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 379/755] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:48 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1361 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:49.187638 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-93c1f996-ef4c-497b-bb28-e0912bf4ded9 req-c68c686b-4761-4443-9e6c-04e3e5570372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c83cdcf-5e96-42c2-9143-725c93f9b828", "tag": "4a4c411b-0c6c-4e00-aba6-9fe7f06a9c10"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:37:49.192679 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:37:49.192679 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:37:49.211552 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-93c1f996-ef4c-497b-bb28-e0912bf4ded9 req-c68c686b-4761-4443-9e6c-04e3e5570372 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:49.212370 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-93c1f996-ef4c-497b-bb28-e0912bf4ded9 req-c68c686b-4761-4443-9e6c-04e3e5570372 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:49.234754 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-93c1f996-ef4c-497b-bb28-e0912bf4ded9 req-c68c686b-4761-4443-9e6c-04e3e5570372 service nova] Creating event network-changed:4a4c411b-0c6c-4e00-aba6-9fe7f06a9c10 for instance 5c83cdcf-5e96-42c2-9143-725c93f9b828 on hv-cinder-78693 Apr 20 18:37:49.241576 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-93c1f996-ef4c-497b-bb28-e0912bf4ded9 req-c68c686b-4761-4443-9e6c-04e3e5570372 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063180 Apr 20 18:37:49.242445 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 380/756] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:37:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:37:49.248803 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-39946ecf-5211-422d-ac2e-d883f8c93c16 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:49.249721 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-39946ecf-5211-422d-ac2e-d883f8c93c16 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:49.259635 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-39946ecf-5211-422d-ac2e-d883f8c93c16 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:49.260162 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-39946ecf-5211-422d-ac2e-d883f8c93c16 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:49.261289 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-39946ecf-5211-422d-ac2e-d883f8c93c16 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:49.261867 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-39946ecf-5211-422d-ac2e-d883f8c93c16 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:49.404116 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-edf07e6b-5fda-4cbd-9802-8ef0a693b952 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Flavor limits 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:37:49.404807 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-edf07e6b-5fda-4cbd-9802-8ef0a693b952 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Image limits 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:37:49.405604 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-edf07e6b-5fda-4cbd-9802-8ef0a693b952 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Flavor pref 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:37:49.406265 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-edf07e6b-5fda-4cbd-9802-8ef0a693b952 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Image pref 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:37:49.406971 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-edf07e6b-5fda-4cbd-9802-8ef0a693b952 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:37:49.417217 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-edf07e6b-5fda-4cbd-9802-8ef0a693b952 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:49.418081 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-edf07e6b-5fda-4cbd-9802-8ef0a693b952 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:49.419216 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-edf07e6b-5fda-4cbd-9802-8ef0a693b952 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:49.419913 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-edf07e6b-5fda-4cbd-9802-8ef0a693b952 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:49.446204 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-edf07e6b-5fda-4cbd-9802-8ef0a693b952 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Getting quotas for project e634dce05f2b45d593dfbca5940a886d. Resources: {'instances', 'ram', 'cores'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:37:49.451614 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-edf07e6b-5fda-4cbd-9802-8ef0a693b952 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Getting quotas for user fb4b8a040bad47f4994f810038c18ddb and project e634dce05f2b45d593dfbca5940a886d. Resources: {'instances', 'ram', 'cores'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:37:49.454800 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-39946ecf-5211-422d-ac2e-d883f8c93c16 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:49.467557 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-edf07e6b-5fda-4cbd-9802-8ef0a693b952 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Going to run 1 instances... {{(pid=100592) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:37:49.470592 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-edf07e6b-5fda-4cbd-9802-8ef0a693b952 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='960a7e5d-8e47-44d2-9fdf-f05dad1c1662',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100592) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:37:49.484692 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-39946ecf-5211-422d-ac2e-d883f8c93c16 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:49.489355 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-39946ecf-5211-422d-ac2e-d883f8c93c16 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:49.491593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-39946ecf-5211-422d-ac2e-d883f8c93c16 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1338 microversion: 2.20 time: 0.247728 Apr 20 18:37:49.492748 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 381/757] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:37:49 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1338 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:37:49.536576 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-edf07e6b-5fda-4cbd-9802-8ef0a693b952 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.489972 Apr 20 18:37:49.537164 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 377/758] 10.222.0.25 () {60 vars in 1137 bytes} [Tue Apr 20 18:37:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 2492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:37:49.552587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-02ed8987-41bd-45f2-8cd3-c0fdb809fecc tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:49.553525 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-02ed8987-41bd-45f2-8cd3-c0fdb809fecc tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:49.667702 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-02ed8987-41bd-45f2-8cd3-c0fdb809fecc tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:49.678354 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-02ed8987-41bd-45f2-8cd3-c0fdb809fecc tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1257 microversion: 2.1 time: 0.133940 Apr 20 18:37:49.679042 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 382/759] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:49 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1257 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:50.185492 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3aa6eb47-a5d0-4fb7-be08-f067cd0250d9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:50.186506 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3aa6eb47-a5d0-4fb7-be08-f067cd0250d9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:50.196906 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3aa6eb47-a5d0-4fb7-be08-f067cd0250d9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:50.197836 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3aa6eb47-a5d0-4fb7-be08-f067cd0250d9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:50.199081 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3aa6eb47-a5d0-4fb7-be08-f067cd0250d9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:50.201991 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3aa6eb47-a5d0-4fb7-be08-f067cd0250d9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:50.514108 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3f81deac-7f09-4ca2-be89-d1b5641be98c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:50.514790 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3f81deac-7f09-4ca2-be89-d1b5641be98c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:50.540786 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3f81deac-7f09-4ca2-be89-d1b5641be98c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:50.541277 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3f81deac-7f09-4ca2-be89-d1b5641be98c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:50.544048 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3f81deac-7f09-4ca2-be89-d1b5641be98c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:50.544551 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3f81deac-7f09-4ca2-be89-d1b5641be98c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:50.874503 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3f81deac-7f09-4ca2-be89-d1b5641be98c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:50.881840 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3aa6eb47-a5d0-4fb7-be08-f067cd0250d9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:50.893167 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3f81deac-7f09-4ca2-be89-d1b5641be98c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:50.896617 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3f81deac-7f09-4ca2-be89-d1b5641be98c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:50.898170 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3f81deac-7f09-4ca2-be89-d1b5641be98c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1406 microversion: 2.20 time: 0.389843 Apr 20 18:37:50.899103 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 383/760] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:37:50 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1406 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:37:50.901842 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3aa6eb47-a5d0-4fb7-be08-f067cd0250d9 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1361 microversion: 2.1 time: 0.717368 Apr 20 18:37:50.906523 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 378/761] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:50 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1361 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:50.917320 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2faee360-2924-4c84-a700-b469458d6489 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:50.918185 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2faee360-2924-4c84-a700-b469458d6489 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:50.927339 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2faee360-2924-4c84-a700-b469458d6489 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:50.927855 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2faee360-2924-4c84-a700-b469458d6489 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:50.928710 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2faee360-2924-4c84-a700-b469458d6489 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:50.929207 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2faee360-2924-4c84-a700-b469458d6489 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:51.161584 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2faee360-2924-4c84-a700-b469458d6489 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:51.196209 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2faee360-2924-4c84-a700-b469458d6489 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1317 microversion: 2.1 time: 0.294981 Apr 20 18:37:51.197151 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 384/762] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:50 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:51.920324 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2d8aca52-3ce7-40f7-8187-f83fbb4ddb80 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:51.921031 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2d8aca52-3ce7-40f7-8187-f83fbb4ddb80 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:51.927040 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-348d746f-5179-4074-91d6-b3ad12acfa0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:51.927986 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-348d746f-5179-4074-91d6-b3ad12acfa0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:51.932993 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2d8aca52-3ce7-40f7-8187-f83fbb4ddb80 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:51.933899 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2d8aca52-3ce7-40f7-8187-f83fbb4ddb80 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:51.936310 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2d8aca52-3ce7-40f7-8187-f83fbb4ddb80 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:51.937348 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2d8aca52-3ce7-40f7-8187-f83fbb4ddb80 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:51.950281 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-348d746f-5179-4074-91d6-b3ad12acfa0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:51.950794 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-348d746f-5179-4074-91d6-b3ad12acfa0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:51.951714 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-348d746f-5179-4074-91d6-b3ad12acfa0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:51.952212 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-348d746f-5179-4074-91d6-b3ad12acfa0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:52.889860 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-348d746f-5179-4074-91d6-b3ad12acfa0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:52.932070 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-348d746f-5179-4074-91d6-b3ad12acfa0f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1361 microversion: 2.1 time: 1.010013 Apr 20 18:37:52.933235 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 385/763] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:51 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1361 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:52.957955 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7eb77b49-d2d1-4891-af4b-e94fc93da33d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:52.959379 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7eb77b49-d2d1-4891-af4b-e94fc93da33d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:52.973346 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7eb77b49-d2d1-4891-af4b-e94fc93da33d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:52.974155 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7eb77b49-d2d1-4891-af4b-e94fc93da33d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:52.976113 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7eb77b49-d2d1-4891-af4b-e94fc93da33d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:52.978606 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7eb77b49-d2d1-4891-af4b-e94fc93da33d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:53.209058 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7eb77b49-d2d1-4891-af4b-e94fc93da33d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:53.223568 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7eb77b49-d2d1-4891-af4b-e94fc93da33d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1315 microversion: 2.1 time: 0.286585 Apr 20 18:37:53.224299 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 386/764] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:52 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:53.962883 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-cb1b4215-1ca1-42a2-8c50-f974040bc7a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:53.964196 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-cb1b4215-1ca1-42a2-8c50-f974040bc7a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:53.982508 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cb1b4215-1ca1-42a2-8c50-f974040bc7a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:53.983405 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cb1b4215-1ca1-42a2-8c50-f974040bc7a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:53.986271 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cb1b4215-1ca1-42a2-8c50-f974040bc7a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:53.987501 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cb1b4215-1ca1-42a2-8c50-f974040bc7a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:54.036410 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2d8aca52-3ce7-40f7-8187-f83fbb4ddb80 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:54.058894 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2d8aca52-3ce7-40f7-8187-f83fbb4ddb80 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:54.062303 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2d8aca52-3ce7-40f7-8187-f83fbb4ddb80 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:54.064315 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2d8aca52-3ce7-40f7-8187-f83fbb4ddb80 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1406 microversion: 2.20 time: 2.148480 Apr 20 18:37:54.065531 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 379/765] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:37:51 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1406 bytes in 2151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:37:54.211696 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-8b9afd91-c3b5-4c0f-aa50-d0a243a3ec73 req-5cd6e339-7638-434a-9307-4a84ea8d820a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976", "tag": "c57f912b-2b41-47e1-bdd2-e6f469efb49c"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:37:54.218581 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:37:54.218581 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:37:54.254308 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-8b9afd91-c3b5-4c0f-aa50-d0a243a3ec73 req-5cd6e339-7638-434a-9307-4a84ea8d820a service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:54.254812 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-8b9afd91-c3b5-4c0f-aa50-d0a243a3ec73 req-5cd6e339-7638-434a-9307-4a84ea8d820a service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:54.303176 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-8b9afd91-c3b5-4c0f-aa50-d0a243a3ec73 req-5cd6e339-7638-434a-9307-4a84ea8d820a service nova] Creating event network-changed:c57f912b-2b41-47e1-bdd2-e6f469efb49c for instance bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 on hv-cinder-78693 Apr 20 18:37:54.326724 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-8b9afd91-c3b5-4c0f-aa50-d0a243a3ec73 req-5cd6e339-7638-434a-9307-4a84ea8d820a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130422 Apr 20 18:37:54.327789 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 380/766] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:37:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:37:54.341787 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-299639fc-7119-4f48-b714-a87807944b51 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:54.344342 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-299639fc-7119-4f48-b714-a87807944b51 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:54.368641 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-299639fc-7119-4f48-b714-a87807944b51 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:54.369904 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-299639fc-7119-4f48-b714-a87807944b51 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:54.371037 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-299639fc-7119-4f48-b714-a87807944b51 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:54.375019 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-299639fc-7119-4f48-b714-a87807944b51 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:54.599978 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-cb1b4215-1ca1-42a2-8c50-f974040bc7a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:54.609699 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-cb1b4215-1ca1-42a2-8c50-f974040bc7a1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1361 microversion: 2.1 time: 0.658973 Apr 20 18:37:54.610459 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 387/767] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:53 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1361 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:54.740562 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-299639fc-7119-4f48-b714-a87807944b51 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:54.754457 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-299639fc-7119-4f48-b714-a87807944b51 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1357 microversion: 2.1 time: 0.422393 Apr 20 18:37:54.755965 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 381/768] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:54 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1357 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:55.105515 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-452759e4-7831-415d-8e97-8c3005ed5c7c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:55.106957 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-452759e4-7831-415d-8e97-8c3005ed5c7c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:55.119953 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-452759e4-7831-415d-8e97-8c3005ed5c7c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:55.120459 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-452759e4-7831-415d-8e97-8c3005ed5c7c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:55.121313 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-452759e4-7831-415d-8e97-8c3005ed5c7c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:55.121839 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-452759e4-7831-415d-8e97-8c3005ed5c7c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:55.421236 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-452759e4-7831-415d-8e97-8c3005ed5c7c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:55.433170 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-452759e4-7831-415d-8e97-8c3005ed5c7c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:55.449021 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-452759e4-7831-415d-8e97-8c3005ed5c7c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:55.451284 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-452759e4-7831-415d-8e97-8c3005ed5c7c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1406 microversion: 2.20 time: 0.354444 Apr 20 18:37:55.452374 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 388/769] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:37:55 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1406 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:37:55.628728 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7cb59c5a-c5c3-4439-95ec-3a567002df8c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:55.629422 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7cb59c5a-c5c3-4439-95ec-3a567002df8c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:55.649590 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7cb59c5a-c5c3-4439-95ec-3a567002df8c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:55.650083 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7cb59c5a-c5c3-4439-95ec-3a567002df8c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:55.651184 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7cb59c5a-c5c3-4439-95ec-3a567002df8c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:55.651689 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7cb59c5a-c5c3-4439-95ec-3a567002df8c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:55.785045 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0667d9b4-4526-4037-b0c9-31100a359fae tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:55.786361 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0667d9b4-4526-4037-b0c9-31100a359fae tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:55.802273 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0667d9b4-4526-4037-b0c9-31100a359fae tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:55.802925 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0667d9b4-4526-4037-b0c9-31100a359fae tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:55.803965 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0667d9b4-4526-4037-b0c9-31100a359fae tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:55.804585 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0667d9b4-4526-4037-b0c9-31100a359fae tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:55.944140 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7cb59c5a-c5c3-4439-95ec-3a567002df8c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:55.971821 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7cb59c5a-c5c3-4439-95ec-3a567002df8c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1361 microversion: 2.1 time: 0.347785 Apr 20 18:37:55.972971 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 382/770] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:55 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1361 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:56.153897 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0667d9b4-4526-4037-b0c9-31100a359fae tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:56.164369 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0667d9b4-4526-4037-b0c9-31100a359fae tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1357 microversion: 2.1 time: 0.387293 Apr 20 18:37:56.165377 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 389/771] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:55 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1357 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:37:56.474814 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-26b41eb5-a862-4301-8ee2-681fb8dc73c4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:56.475779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-26b41eb5-a862-4301-8ee2-681fb8dc73c4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:56.487078 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-26b41eb5-a862-4301-8ee2-681fb8dc73c4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:56.487595 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-26b41eb5-a862-4301-8ee2-681fb8dc73c4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:56.488490 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-26b41eb5-a862-4301-8ee2-681fb8dc73c4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:56.488990 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-26b41eb5-a862-4301-8ee2-681fb8dc73c4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:56.750679 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-26b41eb5-a862-4301-8ee2-681fb8dc73c4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:56.768688 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-26b41eb5-a862-4301-8ee2-681fb8dc73c4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:56.785298 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-26b41eb5-a862-4301-8ee2-681fb8dc73c4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:56.787963 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-26b41eb5-a862-4301-8ee2-681fb8dc73c4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1406 microversion: 2.20 time: 0.318459 Apr 20 18:37:56.789204 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 383/772] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:37:56 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1406 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:37:56.993448 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8461037a-0dbd-4d3e-9f66-176a07e71758 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:56.994246 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8461037a-0dbd-4d3e-9f66-176a07e71758 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:57.005058 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8461037a-0dbd-4d3e-9f66-176a07e71758 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:57.005826 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8461037a-0dbd-4d3e-9f66-176a07e71758 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:57.008063 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8461037a-0dbd-4d3e-9f66-176a07e71758 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:57.011028 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8461037a-0dbd-4d3e-9f66-176a07e71758 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:57.221985 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-27cbd4b2-3127-4f02-afb9-17f4f2bb7acf tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:57.223443 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-27cbd4b2-3127-4f02-afb9-17f4f2bb7acf tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:57.266441 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-27cbd4b2-3127-4f02-afb9-17f4f2bb7acf tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:57.267525 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-27cbd4b2-3127-4f02-afb9-17f4f2bb7acf tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:57.273024 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-27cbd4b2-3127-4f02-afb9-17f4f2bb7acf tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:57.277676 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-27cbd4b2-3127-4f02-afb9-17f4f2bb7acf tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:57.366169 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8461037a-0dbd-4d3e-9f66-176a07e71758 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:57.387897 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8461037a-0dbd-4d3e-9f66-176a07e71758 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1361 microversion: 2.1 time: 0.399400 Apr 20 18:37:57.388487 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 390/773] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:56 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1361 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:57.747484 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-27cbd4b2-3127-4f02-afb9-17f4f2bb7acf tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:57.761224 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-27cbd4b2-3127-4f02-afb9-17f4f2bb7acf tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1357 microversion: 2.1 time: 0.564363 Apr 20 18:37:57.761986 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 384/774] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:57 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1357 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:37:57.834002 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2f25d21e-db4c-4563-b4de-f875e21119f0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:57.835331 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2f25d21e-db4c-4563-b4de-f875e21119f0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:57.848187 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2f25d21e-db4c-4563-b4de-f875e21119f0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:57.849230 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2f25d21e-db4c-4563-b4de-f875e21119f0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:57.850729 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2f25d21e-db4c-4563-b4de-f875e21119f0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:57.851565 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2f25d21e-db4c-4563-b4de-f875e21119f0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:58.280152 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2f25d21e-db4c-4563-b4de-f875e21119f0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:58.317501 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2f25d21e-db4c-4563-b4de-f875e21119f0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:58.319321 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2f25d21e-db4c-4563-b4de-f875e21119f0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:58.320579 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2f25d21e-db4c-4563-b4de-f875e21119f0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1406 microversion: 2.20 time: 0.495067 Apr 20 18:37:58.321603 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 391/775] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:37:57 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1406 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:37:58.433638 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-69f9e5af-de48-49ea-aa49-b47c4a5ba857 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:58.435158 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-69f9e5af-de48-49ea-aa49-b47c4a5ba857 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:58.448918 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-69f9e5af-de48-49ea-aa49-b47c4a5ba857 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:58.449818 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-69f9e5af-de48-49ea-aa49-b47c4a5ba857 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:58.451077 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-69f9e5af-de48-49ea-aa49-b47c4a5ba857 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:58.451780 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-69f9e5af-de48-49ea-aa49-b47c4a5ba857 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:58.687771 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-9c0b2460-637c-40c9-b6fb-dabcd91bc2d4 req-6aa90344-6bf9-454a-88bd-6689ebfab17b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c83cdcf-5e96-42c2-9143-725c93f9b828", "name": "network-vif-plugged", "status": "completed", "tag": "4a4c411b-0c6c-4e00-aba6-9fe7f06a9c10"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:37:58.692114 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:37:58.692114 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:37:58.748033 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-9c0b2460-637c-40c9-b6fb-dabcd91bc2d4 req-6aa90344-6bf9-454a-88bd-6689ebfab17b service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:58.748636 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-9c0b2460-637c-40c9-b6fb-dabcd91bc2d4 req-6aa90344-6bf9-454a-88bd-6689ebfab17b service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:58.802671 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-9c0b2460-637c-40c9-b6fb-dabcd91bc2d4 req-6aa90344-6bf9-454a-88bd-6689ebfab17b service nova] Creating event network-vif-plugged:4a4c411b-0c6c-4e00-aba6-9fe7f06a9c10 for instance 5c83cdcf-5e96-42c2-9143-725c93f9b828 on hv-cinder-78693 Apr 20 18:37:58.808264 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-9c0b2460-637c-40c9-b6fb-dabcd91bc2d4 req-6aa90344-6bf9-454a-88bd-6689ebfab17b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126524 Apr 20 18:37:58.808936 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 392/776] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:37:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:37:58.815127 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a24a0750-1695-4363-9cc3-2b5752cdc2f5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:58.815923 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a24a0750-1695-4363-9cc3-2b5752cdc2f5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:58.826987 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a24a0750-1695-4363-9cc3-2b5752cdc2f5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:58.827586 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a24a0750-1695-4363-9cc3-2b5752cdc2f5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:58.830515 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a24a0750-1695-4363-9cc3-2b5752cdc2f5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:58.831137 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a24a0750-1695-4363-9cc3-2b5752cdc2f5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:58.999420 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-69f9e5af-de48-49ea-aa49-b47c4a5ba857 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:59.045629 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-69f9e5af-de48-49ea-aa49-b47c4a5ba857 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1361 microversion: 2.1 time: 0.629054 Apr 20 18:37:59.047133 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 385/777] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:58 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1361 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:59.257045 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a24a0750-1695-4363-9cc3-2b5752cdc2f5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:59.267214 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a24a0750-1695-4363-9cc3-2b5752cdc2f5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1357 microversion: 2.1 time: 0.456300 Apr 20 18:37:59.275258 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 393/778] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:37:58 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1357 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:37:59.346620 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e697829d-4b18-403c-9839-b7171ff7a551 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:37:59.349452 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e697829d-4b18-403c-9839-b7171ff7a551 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:37:59.364730 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e697829d-4b18-403c-9839-b7171ff7a551 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:59.365361 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e697829d-4b18-403c-9839-b7171ff7a551 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:59.366288 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e697829d-4b18-403c-9839-b7171ff7a551 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:37:59.366787 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e697829d-4b18-403c-9839-b7171ff7a551 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:37:59.655035 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e697829d-4b18-403c-9839-b7171ff7a551 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:59.671381 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e697829d-4b18-403c-9839-b7171ff7a551 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:59.675625 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e697829d-4b18-403c-9839-b7171ff7a551 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:37:59.678071 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e697829d-4b18-403c-9839-b7171ff7a551 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1406 microversion: 2.20 time: 0.339784 Apr 20 18:37:59.679333 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 386/779] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:37:59 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1406 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:38:00.075340 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5fc9fb69-6cc0-4ef3-afb5-93e233029514 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:00.076165 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5fc9fb69-6cc0-4ef3-afb5-93e233029514 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:00.085029 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5fc9fb69-6cc0-4ef3-afb5-93e233029514 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:00.085570 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5fc9fb69-6cc0-4ef3-afb5-93e233029514 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:00.086440 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5fc9fb69-6cc0-4ef3-afb5-93e233029514 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:00.086941 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5fc9fb69-6cc0-4ef3-afb5-93e233029514 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:00.299166 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-afe328c5-62c0-43c9-9678-e0b380863dad tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:00.299855 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-afe328c5-62c0-43c9-9678-e0b380863dad tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:00.308380 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-afe328c5-62c0-43c9-9678-e0b380863dad tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:00.308904 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-afe328c5-62c0-43c9-9678-e0b380863dad tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:00.309827 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-afe328c5-62c0-43c9-9678-e0b380863dad tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:00.310338 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-afe328c5-62c0-43c9-9678-e0b380863dad tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:00.474070 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5fc9fb69-6cc0-4ef3-afb5-93e233029514 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:00.520921 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5fc9fb69-6cc0-4ef3-afb5-93e233029514 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1361 microversion: 2.1 time: 0.450846 Apr 20 18:38:00.525132 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 394/780] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:00 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1361 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:00.648505 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-afe328c5-62c0-43c9-9678-e0b380863dad tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:00.658601 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-afe328c5-62c0-43c9-9678-e0b380863dad tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1357 microversion: 2.1 time: 0.363858 Apr 20 18:38:00.659332 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 387/781] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:00 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1357 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:00.708504 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-275ed8c8-9412-41b4-875b-03ceaa3dc04e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:00.709164 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-275ed8c8-9412-41b4-875b-03ceaa3dc04e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:00.720304 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-275ed8c8-9412-41b4-875b-03ceaa3dc04e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:00.721232 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-275ed8c8-9412-41b4-875b-03ceaa3dc04e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:00.722136 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-275ed8c8-9412-41b4-875b-03ceaa3dc04e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:00.722858 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-275ed8c8-9412-41b4-875b-03ceaa3dc04e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:01.000604 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-275ed8c8-9412-41b4-875b-03ceaa3dc04e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:01.011780 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-275ed8c8-9412-41b4-875b-03ceaa3dc04e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:01.013847 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-275ed8c8-9412-41b4-875b-03ceaa3dc04e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:01.015062 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-275ed8c8-9412-41b4-875b-03ceaa3dc04e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1406 microversion: 2.20 time: 0.312125 Apr 20 18:38:01.015692 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 395/782] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:38:00 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1406 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:38:01.559185 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f87a1e6f-db48-4616-a78d-69c329238aca tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:01.561529 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f87a1e6f-db48-4616-a78d-69c329238aca tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:01.580057 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f87a1e6f-db48-4616-a78d-69c329238aca tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:01.580715 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f87a1e6f-db48-4616-a78d-69c329238aca tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:01.581762 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f87a1e6f-db48-4616-a78d-69c329238aca tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:01.582322 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f87a1e6f-db48-4616-a78d-69c329238aca tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:01.677822 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-551b5efd-10e7-41b3-80fa-aaaab22e086d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:01.679721 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-551b5efd-10e7-41b3-80fa-aaaab22e086d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:01.689046 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-551b5efd-10e7-41b3-80fa-aaaab22e086d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:01.690338 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-551b5efd-10e7-41b3-80fa-aaaab22e086d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:01.691519 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-551b5efd-10e7-41b3-80fa-aaaab22e086d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:01.692110 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-551b5efd-10e7-41b3-80fa-aaaab22e086d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:01.835711 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f87a1e6f-db48-4616-a78d-69c329238aca tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:01.846711 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f87a1e6f-db48-4616-a78d-69c329238aca tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1361 microversion: 2.1 time: 0.292335 Apr 20 18:38:01.857410 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 388/783] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:01 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1361 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:02.039278 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-56439b40-634c-4698-a2cd-c135da6a9d85 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:02.039463 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-551b5efd-10e7-41b3-80fa-aaaab22e086d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:02.041227 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-56439b40-634c-4698-a2cd-c135da6a9d85 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:02.049795 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-551b5efd-10e7-41b3-80fa-aaaab22e086d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1357 microversion: 2.1 time: 0.377027 Apr 20 18:38:02.053444 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 396/784] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:01 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1357 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:38:02.053674 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-56439b40-634c-4698-a2cd-c135da6a9d85 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:02.053674 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-56439b40-634c-4698-a2cd-c135da6a9d85 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:02.053674 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-56439b40-634c-4698-a2cd-c135da6a9d85 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:02.053674 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-56439b40-634c-4698-a2cd-c135da6a9d85 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:02.490578 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-56439b40-634c-4698-a2cd-c135da6a9d85 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:02.513999 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-56439b40-634c-4698-a2cd-c135da6a9d85 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:02.517862 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-56439b40-634c-4698-a2cd-c135da6a9d85 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:02.520247 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-56439b40-634c-4698-a2cd-c135da6a9d85 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1406 microversion: 2.20 time: 0.487603 Apr 20 18:38:02.521855 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 389/785] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:38:02 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1406 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:38:02.864584 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4a7bb6e3-70cf-4d20-8164-a48db97ac3fa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:02.865360 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4a7bb6e3-70cf-4d20-8164-a48db97ac3fa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:02.873564 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4a7bb6e3-70cf-4d20-8164-a48db97ac3fa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:02.873999 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4a7bb6e3-70cf-4d20-8164-a48db97ac3fa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:02.874994 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4a7bb6e3-70cf-4d20-8164-a48db97ac3fa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:02.875573 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4a7bb6e3-70cf-4d20-8164-a48db97ac3fa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:03.071059 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-fa58a942-b1e1-433d-a3a2-63681564bed0 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:03.071829 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-fa58a942-b1e1-433d-a3a2-63681564bed0 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:03.080640 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fa58a942-b1e1-433d-a3a2-63681564bed0 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:03.081160 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fa58a942-b1e1-433d-a3a2-63681564bed0 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:03.082054 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fa58a942-b1e1-433d-a3a2-63681564bed0 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:03.082543 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fa58a942-b1e1-433d-a3a2-63681564bed0 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:03.114763 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4a7bb6e3-70cf-4d20-8164-a48db97ac3fa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:03.126828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4a7bb6e3-70cf-4d20-8164-a48db97ac3fa tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1361 microversion: 2.1 time: 0.264796 Apr 20 18:38:03.135980 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 397/786] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:02 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1361 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:03.390513 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-fa58a942-b1e1-433d-a3a2-63681564bed0 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:03.405505 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-fa58a942-b1e1-433d-a3a2-63681564bed0 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1357 microversion: 2.1 time: 0.339447 Apr 20 18:38:03.406874 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 390/787] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:03 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1357 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:03.541549 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ca034a46-6b9b-4f7e-92d8-02df42e94853 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:03.542229 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ca034a46-6b9b-4f7e-92d8-02df42e94853 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:03.552622 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ca034a46-6b9b-4f7e-92d8-02df42e94853 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:03.552821 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ca034a46-6b9b-4f7e-92d8-02df42e94853 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:03.553982 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ca034a46-6b9b-4f7e-92d8-02df42e94853 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:03.554833 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ca034a46-6b9b-4f7e-92d8-02df42e94853 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:03.788857 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a3137977-f22f-4e23-a512-3996057789ee tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1399405283", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1782040926", "security_groups": [{"name": "tempest-secgroup-smoke-1408344531"}], "block_device_mapping_v2": [{"uuid": "68e5c09c-f2f6-4267-b9fd-3edafdf2b0df", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8bd2d403-a674-4166-b6a7-876b78a5d8d4"}]}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:04.384241 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.network.neutron [None req-a3137977-f22f-4e23-a512-3996057789ee tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] validate_networks() for [('8bd2d403-a674-4166-b6a7-876b78a5d8d4', None, None, None)] {{(pid=100592) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:38:04.399405 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ca034a46-6b9b-4f7e-92d8-02df42e94853 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:04.438056 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ca034a46-6b9b-4f7e-92d8-02df42e94853 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:04.440759 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ca034a46-6b9b-4f7e-92d8-02df42e94853 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:04.442880 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ca034a46-6b9b-4f7e-92d8-02df42e94853 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1406 microversion: 2.20 time: 0.905596 Apr 20 18:38:04.444128 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 398/788] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:38:03 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1406 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:38:04.453291 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-da39d128-47da-4670-90b9-63379fc64d68 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:04.455085 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-da39d128-47da-4670-90b9-63379fc64d68 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:04.466226 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-da39d128-47da-4670-90b9-63379fc64d68 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:04.466864 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-da39d128-47da-4670-90b9-63379fc64d68 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:04.467859 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-da39d128-47da-4670-90b9-63379fc64d68 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:04.468464 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-da39d128-47da-4670-90b9-63379fc64d68 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:05.383600 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-da39d128-47da-4670-90b9-63379fc64d68 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:05.425848 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-da39d128-47da-4670-90b9-63379fc64d68 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1361 microversion: 2.1 time: 0.978310 Apr 20 18:38:05.429817 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 399/789] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:04 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1361 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:05.441517 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e4ef32fe-4283-47d9-8eec-1263317db898 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:05.453962 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e4ef32fe-4283-47d9-8eec-1263317db898 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:05.477251 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e4ef32fe-4283-47d9-8eec-1263317db898 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:05.478796 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e4ef32fe-4283-47d9-8eec-1263317db898 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:05.480611 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e4ef32fe-4283-47d9-8eec-1263317db898 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:05.481773 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e4ef32fe-4283-47d9-8eec-1263317db898 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:05.676470 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-a3137977-f22f-4e23-a512-3996057789ee tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Flavor limits 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:38:05.677258 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-a3137977-f22f-4e23-a512-3996057789ee tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Image limits 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:38:05.678031 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-a3137977-f22f-4e23-a512-3996057789ee tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Flavor pref 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:38:05.679333 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-a3137977-f22f-4e23-a512-3996057789ee tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Image pref 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:38:05.679989 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-a3137977-f22f-4e23-a512-3996057789ee tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:38:05.697153 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a3137977-f22f-4e23-a512-3996057789ee tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:05.697670 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a3137977-f22f-4e23-a512-3996057789ee tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:05.706759 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a3137977-f22f-4e23-a512-3996057789ee tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:05.707534 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a3137977-f22f-4e23-a512-3996057789ee tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:05.763066 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-a3137977-f22f-4e23-a512-3996057789ee tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Getting quotas for project d38b0824b83f40c9874ffbc291951949. Resources: {'instances', 'ram', 'cores'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:38:05.773436 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-a3137977-f22f-4e23-a512-3996057789ee tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Getting quotas for user 7a04013dbac84c5f93bdb7946e50d21d and project d38b0824b83f40c9874ffbc291951949. Resources: {'instances', 'ram', 'cores'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:38:05.918874 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a3137977-f22f-4e23-a512-3996057789ee tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Going to run 1 instances... {{(pid=100592) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:38:05.921479 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a3137977-f22f-4e23-a512-3996057789ee tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68e5c09c-f2f6-4267-b9fd-3edafdf2b0df',volume_size=None,volume_type=None)] {{(pid=100592) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:38:05.931695 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e4ef32fe-4283-47d9-8eec-1263317db898 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:05.944208 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e4ef32fe-4283-47d9-8eec-1263317db898 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1357 microversion: 2.1 time: 0.511509 Apr 20 18:38:05.944919 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 400/790] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:05 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1357 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:05.952620 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-036421e1-50f5-41f9-850e-2ffa79d02ed8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:05.953282 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-036421e1-50f5-41f9-850e-2ffa79d02ed8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:05.962359 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-036421e1-50f5-41f9-850e-2ffa79d02ed8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:05.962665 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-036421e1-50f5-41f9-850e-2ffa79d02ed8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:05.963416 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-036421e1-50f5-41f9-850e-2ffa79d02ed8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:05.964277 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-036421e1-50f5-41f9-850e-2ffa79d02ed8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:06.163549 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a3137977-f22f-4e23-a512-3996057789ee tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.378796 Apr 20 18:38:06.164254 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 391/791] 10.222.0.25 () {60 vars in 1137 bytes} [Tue Apr 20 18:38:03 2021] POST /compute/v2.1/servers => generated 406 bytes in 2380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:38:06.468605 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-5e293174-06b6-41d9-9ddc-1f7625065df3 req-616e8bbb-ae77-4ae1-a5f7-fcac3c645e9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fa521e9-06dd-4516-8413-ce388953fe59", "tag": "d5b99ffe-cbe8-42b3-8e44-5a3598c73540"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:06.471894 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:38:06.471894 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:38:06.495607 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-5e293174-06b6-41d9-9ddc-1f7625065df3 req-616e8bbb-ae77-4ae1-a5f7-fcac3c645e9e service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:06.496465 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-5e293174-06b6-41d9-9ddc-1f7625065df3 req-616e8bbb-ae77-4ae1-a5f7-fcac3c645e9e service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:06.515883 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-5e293174-06b6-41d9-9ddc-1f7625065df3 req-616e8bbb-ae77-4ae1-a5f7-fcac3c645e9e service nova] Creating event network-changed:d5b99ffe-cbe8-42b3-8e44-5a3598c73540 for instance 4fa521e9-06dd-4516-8413-ce388953fe59 on hv-cinder-78693 Apr 20 18:38:06.526139 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-5e293174-06b6-41d9-9ddc-1f7625065df3 req-616e8bbb-ae77-4ae1-a5f7-fcac3c645e9e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.360153 Apr 20 18:38:06.527518 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 392/792] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:38:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:38:06.534543 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-fe0c357c-656d-4ede-bd14-33797ec72208 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:06.535343 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-fe0c357c-656d-4ede-bd14-33797ec72208 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:06.621568 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-036421e1-50f5-41f9-850e-2ffa79d02ed8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:06.636443 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-036421e1-50f5-41f9-850e-2ffa79d02ed8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:06.639011 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-036421e1-50f5-41f9-850e-2ffa79d02ed8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:06.640647 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-036421e1-50f5-41f9-850e-2ffa79d02ed8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1406 microversion: 2.20 time: 0.694763 Apr 20 18:38:06.641693 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 401/793] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:38:05 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1406 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:38:06.648284 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e8211c63-ef35-4511-8f9a-5f696b4c8aad tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:06.649329 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e8211c63-ef35-4511-8f9a-5f696b4c8aad tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:06.658894 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-fe0c357c-656d-4ede-bd14-33797ec72208 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:06.659396 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e8211c63-ef35-4511-8f9a-5f696b4c8aad tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:06.661649 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e8211c63-ef35-4511-8f9a-5f696b4c8aad tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:06.662922 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e8211c63-ef35-4511-8f9a-5f696b4c8aad tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:06.663836 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e8211c63-ef35-4511-8f9a-5f696b4c8aad tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:06.667409 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-fe0c357c-656d-4ede-bd14-33797ec72208 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 200 len: 1095 microversion: 2.1 time: 0.138505 Apr 20 18:38:06.668273 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 393/794] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:06 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 1095 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:06.978227 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e7fb513c-aefe-46c6-bf89-e63f3ec4dc36 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:06.980285 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e7fb513c-aefe-46c6-bf89-e63f3ec4dc36 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:06.999412 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e7fb513c-aefe-46c6-bf89-e63f3ec4dc36 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:07.000358 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e7fb513c-aefe-46c6-bf89-e63f3ec4dc36 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:07.003229 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e7fb513c-aefe-46c6-bf89-e63f3ec4dc36 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:07.004084 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e7fb513c-aefe-46c6-bf89-e63f3ec4dc36 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:07.075261 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e8211c63-ef35-4511-8f9a-5f696b4c8aad tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:07.100724 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e8211c63-ef35-4511-8f9a-5f696b4c8aad tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1547 microversion: 2.1 time: 0.456894 Apr 20 18:38:07.102985 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 402/795] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:06 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1547 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:07.133465 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-018b5b01-62b1-4e70-b4ca-5c0bef45bcf2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:07.134319 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-018b5b01-62b1-4e70-b4ca-5c0bef45bcf2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:07.152320 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-018b5b01-62b1-4e70-b4ca-5c0bef45bcf2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:07.153335 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-018b5b01-62b1-4e70-b4ca-5c0bef45bcf2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:07.154723 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-018b5b01-62b1-4e70-b4ca-5c0bef45bcf2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:07.155230 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-018b5b01-62b1-4e70-b4ca-5c0bef45bcf2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:07.572710 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-018b5b01-62b1-4e70-b4ca-5c0bef45bcf2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.444483 Apr 20 18:38:07.574028 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 403/796] 10.222.0.25 () {58 vars in 1265 bytes} [Tue Apr 20 18:38:07 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/os-interface => generated 285 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:38:07.666502 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f6b23b48-28f4-4e66-97fd-aef8856fd858 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:07.667309 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f6b23b48-28f4-4e66-97fd-aef8856fd858 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:07.674655 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e7fb513c-aefe-46c6-bf89-e63f3ec4dc36 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:07.687696 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f6b23b48-28f4-4e66-97fd-aef8856fd858 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:07.689760 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f6b23b48-28f4-4e66-97fd-aef8856fd858 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:07.693462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e7fb513c-aefe-46c6-bf89-e63f3ec4dc36 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1357 microversion: 2.1 time: 0.726921 Apr 20 18:38:07.693462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 394/797] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:06 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1357 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:38:07.696780 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f6b23b48-28f4-4e66-97fd-aef8856fd858 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:07.697781 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f6b23b48-28f4-4e66-97fd-aef8856fd858 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:07.723048 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-81449217-aa39-4e74-a35e-13ee8b12fbc1 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:07.724471 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-81449217-aa39-4e74-a35e-13ee8b12fbc1 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:07.742527 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-81449217-aa39-4e74-a35e-13ee8b12fbc1 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:07.743399 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-81449217-aa39-4e74-a35e-13ee8b12fbc1 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:07.744880 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-81449217-aa39-4e74-a35e-13ee8b12fbc1 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:07.745772 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-81449217-aa39-4e74-a35e-13ee8b12fbc1 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:08.019453 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-81449217-aa39-4e74-a35e-13ee8b12fbc1 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:08.045957 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-81449217-aa39-4e74-a35e-13ee8b12fbc1 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 200 len: 1201 microversion: 2.1 time: 0.337416 Apr 20 18:38:08.047112 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 395/798] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:07 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 1201 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:08.578855 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f6b23b48-28f4-4e66-97fd-aef8856fd858 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:08.605274 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f6b23b48-28f4-4e66-97fd-aef8856fd858 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:08.609673 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f6b23b48-28f4-4e66-97fd-aef8856fd858 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:08.613108 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f6b23b48-28f4-4e66-97fd-aef8856fd858 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1406 microversion: 2.20 time: 0.953508 Apr 20 18:38:08.614256 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 404/799] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:38:07 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1406 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:38:08.728192 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-49205483-800a-4dc2-a1a3-2551fbaa7754 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:08.729890 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-49205483-800a-4dc2-a1a3-2551fbaa7754 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:08.745747 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-49205483-800a-4dc2-a1a3-2551fbaa7754 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:08.747171 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-49205483-800a-4dc2-a1a3-2551fbaa7754 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:08.749302 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-49205483-800a-4dc2-a1a3-2551fbaa7754 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:08.755813 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-49205483-800a-4dc2-a1a3-2551fbaa7754 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:09.076395 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4efe8372-bd7c-4ae0-906c-586c0312888b tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:09.077736 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4efe8372-bd7c-4ae0-906c-586c0312888b tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:09.092721 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4efe8372-bd7c-4ae0-906c-586c0312888b tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:09.094096 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4efe8372-bd7c-4ae0-906c-586c0312888b tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:09.095776 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4efe8372-bd7c-4ae0-906c-586c0312888b tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:09.096718 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4efe8372-bd7c-4ae0-906c-586c0312888b tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:09.455228 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-49205483-800a-4dc2-a1a3-2551fbaa7754 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:09.466732 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-49205483-800a-4dc2-a1a3-2551fbaa7754 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1357 microversion: 2.1 time: 0.746673 Apr 20 18:38:09.467844 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 396/800] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:08 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1357 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:09.593440 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4efe8372-bd7c-4ae0-906c-586c0312888b tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:09.602001 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4efe8372-bd7c-4ae0-906c-586c0312888b tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 200 len: 1211 microversion: 2.1 time: 0.540169 Apr 20 18:38:09.603180 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 405/801] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:09 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 1211 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:09.633114 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c44cf95b-a980-4704-8b58-5f81b6019b63 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:09.633847 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c44cf95b-a980-4704-8b58-5f81b6019b63 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:09.645364 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c44cf95b-a980-4704-8b58-5f81b6019b63 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:09.645914 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c44cf95b-a980-4704-8b58-5f81b6019b63 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:09.647130 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c44cf95b-a980-4704-8b58-5f81b6019b63 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:09.647697 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c44cf95b-a980-4704-8b58-5f81b6019b63 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:10.175466 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c44cf95b-a980-4704-8b58-5f81b6019b63 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:10.186282 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c44cf95b-a980-4704-8b58-5f81b6019b63 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:10.188939 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c44cf95b-a980-4704-8b58-5f81b6019b63 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:10.189971 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c44cf95b-a980-4704-8b58-5f81b6019b63 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1406 microversion: 2.20 time: 0.561012 Apr 20 18:38:10.191030 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 397/802] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:38:09 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1406 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:38:10.506523 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-480064b6-6445-4275-a6fb-c3b69774c36d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:10.507482 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-480064b6-6445-4275-a6fb-c3b69774c36d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:10.519083 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-480064b6-6445-4275-a6fb-c3b69774c36d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:10.519589 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-480064b6-6445-4275-a6fb-c3b69774c36d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:10.520687 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-480064b6-6445-4275-a6fb-c3b69774c36d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:10.521353 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-480064b6-6445-4275-a6fb-c3b69774c36d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:10.629104 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6f4cae6d-abf8-4510-978d-a11197ffaef1 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:10.630213 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6f4cae6d-abf8-4510-978d-a11197ffaef1 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:10.641009 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6f4cae6d-abf8-4510-978d-a11197ffaef1 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:10.643953 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6f4cae6d-abf8-4510-978d-a11197ffaef1 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:10.645997 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6f4cae6d-abf8-4510-978d-a11197ffaef1 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:10.646917 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6f4cae6d-abf8-4510-978d-a11197ffaef1 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:11.371508 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-480064b6-6445-4275-a6fb-c3b69774c36d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:11.408647 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-480064b6-6445-4275-a6fb-c3b69774c36d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1357 microversion: 2.1 time: 0.923908 Apr 20 18:38:11.421435 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 406/803] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:10 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1357 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:11.430384 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c013a729-4f0b-4bd1-a4e0-6ee0917d42f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:11.430384 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c013a729-4f0b-4bd1-a4e0-6ee0917d42f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:11.448207 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c013a729-4f0b-4bd1-a4e0-6ee0917d42f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:11.449752 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c013a729-4f0b-4bd1-a4e0-6ee0917d42f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:11.451720 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c013a729-4f0b-4bd1-a4e0-6ee0917d42f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:11.453327 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c013a729-4f0b-4bd1-a4e0-6ee0917d42f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:11.489768 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6f4cae6d-abf8-4510-978d-a11197ffaef1 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:11.530781 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6f4cae6d-abf8-4510-978d-a11197ffaef1 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 200 len: 1267 microversion: 2.1 time: 0.906240 Apr 20 18:38:11.545565 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 398/804] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:10 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 1267 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:38:11.554730 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5050fabc-ef6d-42f1-b163-626595bce960 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:11.554730 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5050fabc-ef6d-42f1-b163-626595bce960 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:11.572679 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5050fabc-ef6d-42f1-b163-626595bce960 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:11.573582 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5050fabc-ef6d-42f1-b163-626595bce960 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:11.575654 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5050fabc-ef6d-42f1-b163-626595bce960 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:11.576332 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5050fabc-ef6d-42f1-b163-626595bce960 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:11.837180 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5050fabc-ef6d-42f1-b163-626595bce960 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 14 microversion: 2.1 time: 0.293794 Apr 20 18:38:11.839212 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 399/805] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:11 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 14 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:38:11.854260 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-4a853a0b-03d3-4923-b48f-20c9cf86311b req-e0112ef6-51c9-4202-ada7-cbd8554dd81b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c83cdcf-5e96-42c2-9143-725c93f9b828", "tag": "4a4c411b-0c6c-4e00-aba6-9fe7f06a9c10"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:11.871708 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:38:11.871708 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:38:11.907108 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-4a853a0b-03d3-4923-b48f-20c9cf86311b req-e0112ef6-51c9-4202-ada7-cbd8554dd81b service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:11.908707 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-4a853a0b-03d3-4923-b48f-20c9cf86311b req-e0112ef6-51c9-4202-ada7-cbd8554dd81b service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:11.952707 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-4a853a0b-03d3-4923-b48f-20c9cf86311b req-e0112ef6-51c9-4202-ada7-cbd8554dd81b service nova] Creating event network-changed:4a4c411b-0c6c-4e00-aba6-9fe7f06a9c10 for instance 5c83cdcf-5e96-42c2-9143-725c93f9b828 on hv-cinder-78693 Apr 20 18:38:11.968582 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-4a853a0b-03d3-4923-b48f-20c9cf86311b req-e0112ef6-51c9-4202-ada7-cbd8554dd81b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126848 Apr 20 18:38:11.969726 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 400/806] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:38:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:38:11.975802 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-cb0e5613-b525-49be-92e8-11ce3e466d6c req-27d5e013-9071-4e61-9b48-fc062f639156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4e41ddc-6fad-4179-8d1b-55e8bc4044c8", "tag": "4fda7bf6-0fcd-4ef5-b14d-d4ef76e12de0"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:11.988074 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:38:11.988074 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:38:12.014760 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-cb0e5613-b525-49be-92e8-11ce3e466d6c req-27d5e013-9071-4e61-9b48-fc062f639156 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:12.015278 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-cb0e5613-b525-49be-92e8-11ce3e466d6c req-27d5e013-9071-4e61-9b48-fc062f639156 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:12.094319 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-cb0e5613-b525-49be-92e8-11ce3e466d6c req-27d5e013-9071-4e61-9b48-fc062f639156 service nova] Creating event network-changed:4fda7bf6-0fcd-4ef5-b14d-d4ef76e12de0 for instance f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 on hv-cinder-78693 Apr 20 18:38:12.113720 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-cb0e5613-b525-49be-92e8-11ce3e466d6c req-27d5e013-9071-4e61-9b48-fc062f639156 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140167 Apr 20 18:38:12.115395 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 401/807] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:38:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:38:12.210146 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c013a729-4f0b-4bd1-a4e0-6ee0917d42f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:12.232661 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c013a729-4f0b-4bd1-a4e0-6ee0917d42f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:12.237941 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c013a729-4f0b-4bd1-a4e0-6ee0917d42f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:12.240866 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c013a729-4f0b-4bd1-a4e0-6ee0917d42f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1406 microversion: 2.20 time: 0.820756 Apr 20 18:38:12.242387 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 407/808] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:38:11 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1406 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:38:12.452437 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8527aa4d-433c-4dde-b7d2-8de7b56a7a2d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:12.466178 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8527aa4d-433c-4dde-b7d2-8de7b56a7a2d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:12.515275 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8527aa4d-433c-4dde-b7d2-8de7b56a7a2d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:12.516234 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8527aa4d-433c-4dde-b7d2-8de7b56a7a2d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:12.518018 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8527aa4d-433c-4dde-b7d2-8de7b56a7a2d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:12.518934 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8527aa4d-433c-4dde-b7d2-8de7b56a7a2d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:12.566197 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6efb9e8a-a79e-4e03-ad9e-e8224468fd02 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:12.582419 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6efb9e8a-a79e-4e03-ad9e-e8224468fd02 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:12.599491 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6efb9e8a-a79e-4e03-ad9e-e8224468fd02 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:12.599902 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6efb9e8a-a79e-4e03-ad9e-e8224468fd02 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:12.600798 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6efb9e8a-a79e-4e03-ad9e-e8224468fd02 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:12.601302 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6efb9e8a-a79e-4e03-ad9e-e8224468fd02 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:13.295896 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6efb9e8a-a79e-4e03-ad9e-e8224468fd02 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:13.327652 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6efb9e8a-a79e-4e03-ad9e-e8224468fd02 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 200 len: 1267 microversion: 2.1 time: 0.762984 Apr 20 18:38:13.337841 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 408/809] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:12 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 1267 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:13.352280 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-156f91f9-883d-41b7-8b19-9d9646a8a54b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:13.354617 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-156f91f9-883d-41b7-8b19-9d9646a8a54b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:13.394661 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-156f91f9-883d-41b7-8b19-9d9646a8a54b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:13.401899 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-156f91f9-883d-41b7-8b19-9d9646a8a54b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:13.404011 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-156f91f9-883d-41b7-8b19-9d9646a8a54b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:13.405365 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-156f91f9-883d-41b7-8b19-9d9646a8a54b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:13.649596 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8527aa4d-433c-4dde-b7d2-8de7b56a7a2d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:13.667536 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8527aa4d-433c-4dde-b7d2-8de7b56a7a2d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1357 microversion: 2.1 time: 1.230654 Apr 20 18:38:13.674218 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 402/810] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:12 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1357 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:38:13.686412 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b6ace5e6-16c7-4201-b0d5-8fdc05840096 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:13.687121 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b6ace5e6-16c7-4201-b0d5-8fdc05840096 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:13.699621 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b6ace5e6-16c7-4201-b0d5-8fdc05840096 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:13.700140 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b6ace5e6-16c7-4201-b0d5-8fdc05840096 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:13.701034 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b6ace5e6-16c7-4201-b0d5-8fdc05840096 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:13.701577 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b6ace5e6-16c7-4201-b0d5-8fdc05840096 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:13.728490 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-156f91f9-883d-41b7-8b19-9d9646a8a54b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 14 microversion: 2.1 time: 0.385684 Apr 20 18:38:13.729237 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 409/811] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:13 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 14 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:38:14.178671 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b6ace5e6-16c7-4201-b0d5-8fdc05840096 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:14.191365 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b6ace5e6-16c7-4201-b0d5-8fdc05840096 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:14.193177 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b6ace5e6-16c7-4201-b0d5-8fdc05840096 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:14.200496 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b6ace5e6-16c7-4201-b0d5-8fdc05840096 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1406 microversion: 2.20 time: 0.517720 Apr 20 18:38:14.200496 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 403/812] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:38:13 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1406 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:38:14.362081 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-fcfefd68-d2e3-4e77-9ef9-ddaeb7badc1f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:14.363735 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-fcfefd68-d2e3-4e77-9ef9-ddaeb7badc1f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:14.406097 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fcfefd68-d2e3-4e77-9ef9-ddaeb7badc1f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:14.407891 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fcfefd68-d2e3-4e77-9ef9-ddaeb7badc1f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:14.409717 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fcfefd68-d2e3-4e77-9ef9-ddaeb7badc1f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:14.410871 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fcfefd68-d2e3-4e77-9ef9-ddaeb7badc1f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:14.702500 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8c23e40b-385e-4933-882b-07b5cd760b33 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:14.704924 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8c23e40b-385e-4933-882b-07b5cd760b33 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:14.716019 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-fcfefd68-d2e3-4e77-9ef9-ddaeb7badc1f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:14.722629 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8c23e40b-385e-4933-882b-07b5cd760b33 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:14.724158 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8c23e40b-385e-4933-882b-07b5cd760b33 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:14.726015 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8c23e40b-385e-4933-882b-07b5cd760b33 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:14.727162 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8c23e40b-385e-4933-882b-07b5cd760b33 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:14.733467 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-fcfefd68-d2e3-4e77-9ef9-ddaeb7badc1f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 200 len: 1267 microversion: 2.1 time: 0.381736 Apr 20 18:38:14.734668 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 410/813] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:14 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 1267 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:14.757113 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-499298ae-4133-4d68-953f-387c2b4aae1d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:14.758520 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-499298ae-4133-4d68-953f-387c2b4aae1d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:14.768733 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-499298ae-4133-4d68-953f-387c2b4aae1d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:14.769558 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-499298ae-4133-4d68-953f-387c2b4aae1d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:14.771113 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-499298ae-4133-4d68-953f-387c2b4aae1d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:14.771773 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-499298ae-4133-4d68-953f-387c2b4aae1d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:14.928300 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-499298ae-4133-4d68-953f-387c2b4aae1d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 14 microversion: 2.1 time: 0.177609 Apr 20 18:38:14.929684 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 411/814] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:14 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:38:15.020817 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-1fd68d22-0299-49a8-b096-7b8ee21a3635 req-9bf92cc3-2439-4fcb-91e4-e03e4a85cbf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976", "name": "network-vif-plugged", "status": "completed", "tag": "c57f912b-2b41-47e1-bdd2-e6f469efb49c"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:15.022846 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:38:15.022846 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:38:15.050153 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-1fd68d22-0299-49a8-b096-7b8ee21a3635 req-9bf92cc3-2439-4fcb-91e4-e03e4a85cbf1 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:15.050665 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-1fd68d22-0299-49a8-b096-7b8ee21a3635 req-9bf92cc3-2439-4fcb-91e4-e03e4a85cbf1 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:15.104448 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-1fd68d22-0299-49a8-b096-7b8ee21a3635 req-9bf92cc3-2439-4fcb-91e4-e03e4a85cbf1 service nova] Creating event network-vif-plugged:c57f912b-2b41-47e1-bdd2-e6f469efb49c for instance bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 on hv-cinder-78693 Apr 20 18:38:15.123936 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-1fd68d22-0299-49a8-b096-7b8ee21a3635 req-9bf92cc3-2439-4fcb-91e4-e03e4a85cbf1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108192 Apr 20 18:38:15.125968 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 412/815] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:38:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:38:15.232017 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f31a6e71-b737-4b7e-988a-cbce82cef89a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:15.249907 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f31a6e71-b737-4b7e-988a-cbce82cef89a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:15.281300 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f31a6e71-b737-4b7e-988a-cbce82cef89a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:15.282919 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f31a6e71-b737-4b7e-988a-cbce82cef89a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:15.287065 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f31a6e71-b737-4b7e-988a-cbce82cef89a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:15.289338 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f31a6e71-b737-4b7e-988a-cbce82cef89a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:15.302445 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8c23e40b-385e-4933-882b-07b5cd760b33 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:15.320354 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8c23e40b-385e-4933-882b-07b5cd760b33 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1357 microversion: 2.1 time: 0.626940 Apr 20 18:38:15.335532 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 404/816] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:14 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1357 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:15.741827 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f31a6e71-b737-4b7e-988a-cbce82cef89a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:15.754599 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f31a6e71-b737-4b7e-988a-cbce82cef89a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:15.760641 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7510efee-0156-4845-b49b-c08d995f660c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:15.761844 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7510efee-0156-4845-b49b-c08d995f660c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:15.767106 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f31a6e71-b737-4b7e-988a-cbce82cef89a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:15.768336 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f31a6e71-b737-4b7e-988a-cbce82cef89a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1406 microversion: 2.20 time: 0.550641 Apr 20 18:38:15.769179 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 413/817] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:38:15 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1406 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:38:15.774683 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7510efee-0156-4845-b49b-c08d995f660c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:15.775188 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7510efee-0156-4845-b49b-c08d995f660c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:15.776012 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7510efee-0156-4845-b49b-c08d995f660c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:15.776706 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7510efee-0156-4845-b49b-c08d995f660c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:15.952933 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-810415f2-ef9d-4198-9ba9-73a7fd5a5341 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:15.955086 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-810415f2-ef9d-4198-9ba9-73a7fd5a5341 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:15.964492 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-810415f2-ef9d-4198-9ba9-73a7fd5a5341 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:15.965107 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-810415f2-ef9d-4198-9ba9-73a7fd5a5341 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:15.966155 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-810415f2-ef9d-4198-9ba9-73a7fd5a5341 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:15.966669 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-810415f2-ef9d-4198-9ba9-73a7fd5a5341 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:16.032017 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7510efee-0156-4845-b49b-c08d995f660c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:16.042706 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7510efee-0156-4845-b49b-c08d995f660c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 200 len: 1267 microversion: 2.1 time: 0.286255 Apr 20 18:38:16.043352 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 405/818] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:15 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 1267 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:16.113920 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-810415f2-ef9d-4198-9ba9-73a7fd5a5341 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 14 microversion: 2.1 time: 0.174464 Apr 20 18:38:16.114638 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 414/819] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:15 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:38:16.344621 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c71257fb-e3b3-46cc-b015-4e42fef95ca2 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:16.345638 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c71257fb-e3b3-46cc-b015-4e42fef95ca2 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:16.354213 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c71257fb-e3b3-46cc-b015-4e42fef95ca2 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:16.354725 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c71257fb-e3b3-46cc-b015-4e42fef95ca2 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:16.355595 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c71257fb-e3b3-46cc-b015-4e42fef95ca2 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:16.356091 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c71257fb-e3b3-46cc-b015-4e42fef95ca2 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:16.590059 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c71257fb-e3b3-46cc-b015-4e42fef95ca2 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:16.604640 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c71257fb-e3b3-46cc-b015-4e42fef95ca2 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1357 microversion: 2.1 time: 0.265024 Apr 20 18:38:16.605909 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 406/820] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:16 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1357 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:16.789311 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-81e244ff-04cc-41e8-91cb-292240c539d3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:16.790015 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-81e244ff-04cc-41e8-91cb-292240c539d3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:16.799540 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-81e244ff-04cc-41e8-91cb-292240c539d3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:16.800061 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-81e244ff-04cc-41e8-91cb-292240c539d3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:16.800942 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-81e244ff-04cc-41e8-91cb-292240c539d3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:16.801473 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-81e244ff-04cc-41e8-91cb-292240c539d3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:17.048667 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-81e244ff-04cc-41e8-91cb-292240c539d3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:17.059091 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-81e244ff-04cc-41e8-91cb-292240c539d3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:17.060786 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-81e244ff-04cc-41e8-91cb-292240c539d3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:17.062061 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-81e244ff-04cc-41e8-91cb-292240c539d3 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1406 microversion: 2.20 time: 0.277555 Apr 20 18:38:17.063531 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 415/821] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:38:16 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1406 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:38:17.070077 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7d16b722-b1d2-479c-948c-6a09b1ee95d4 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:17.070870 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7d16b722-b1d2-479c-948c-6a09b1ee95d4 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:17.079796 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7d16b722-b1d2-479c-948c-6a09b1ee95d4 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:17.080311 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7d16b722-b1d2-479c-948c-6a09b1ee95d4 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:17.081163 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7d16b722-b1d2-479c-948c-6a09b1ee95d4 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:17.081721 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7d16b722-b1d2-479c-948c-6a09b1ee95d4 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:17.129029 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b1a37c4e-2c21-4f3b-bc9a-71fd5c3c1510 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:17.130530 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b1a37c4e-2c21-4f3b-bc9a-71fd5c3c1510 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:17.139181 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b1a37c4e-2c21-4f3b-bc9a-71fd5c3c1510 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:17.139682 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b1a37c4e-2c21-4f3b-bc9a-71fd5c3c1510 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:17.140534 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b1a37c4e-2c21-4f3b-bc9a-71fd5c3c1510 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:17.141077 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b1a37c4e-2c21-4f3b-bc9a-71fd5c3c1510 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:17.276651 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b1a37c4e-2c21-4f3b-bc9a-71fd5c3c1510 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 14 microversion: 2.1 time: 0.154202 Apr 20 18:38:17.282101 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 416/822] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:17 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:38:17.290062 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-867afbd0-e450-4e0f-b54e-f228983462ce req-5384b918-ea1f-4e68-9c9c-0d18c9293ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fa521e9-06dd-4516-8413-ce388953fe59", "name": "network-vif-plugged", "status": "completed", "tag": "d5b99ffe-cbe8-42b3-8e44-5a3598c73540"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:17.291814 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:38:17.291814 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:38:17.302683 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-867afbd0-e450-4e0f-b54e-f228983462ce req-5384b918-ea1f-4e68-9c9c-0d18c9293ca0 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:17.303107 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-867afbd0-e450-4e0f-b54e-f228983462ce req-5384b918-ea1f-4e68-9c9c-0d18c9293ca0 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:17.318551 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7d16b722-b1d2-479c-948c-6a09b1ee95d4 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:17.322718 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-867afbd0-e450-4e0f-b54e-f228983462ce req-5384b918-ea1f-4e68-9c9c-0d18c9293ca0 service nova] Creating event network-vif-plugged:d5b99ffe-cbe8-42b3-8e44-5a3598c73540 for instance 4fa521e9-06dd-4516-8413-ce388953fe59 on hv-cinder-78693 Apr 20 18:38:17.328066 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-867afbd0-e450-4e0f-b54e-f228983462ce req-5384b918-ea1f-4e68-9c9c-0d18c9293ca0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047028 Apr 20 18:38:17.328926 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 417/823] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:38:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:38:17.330244 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7d16b722-b1d2-479c-948c-6a09b1ee95d4 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 200 len: 1267 microversion: 2.1 time: 0.264072 Apr 20 18:38:17.330900 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 407/824] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:17 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 1267 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:17.624558 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d028871c-456c-43f6-a628-83ee7dab0cdc tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:17.625269 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d028871c-456c-43f6-a628-83ee7dab0cdc tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:17.634743 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d028871c-456c-43f6-a628-83ee7dab0cdc tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:17.635254 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d028871c-456c-43f6-a628-83ee7dab0cdc tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:17.636094 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d028871c-456c-43f6-a628-83ee7dab0cdc tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:17.636584 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d028871c-456c-43f6-a628-83ee7dab0cdc tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:17.870936 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d028871c-456c-43f6-a628-83ee7dab0cdc tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:17.880929 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d028871c-456c-43f6-a628-83ee7dab0cdc tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1357 microversion: 2.1 time: 0.261066 Apr 20 18:38:17.881532 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 418/825] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:17 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1357 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:18.083455 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-37859089-e5fa-43d8-a75a-eef1683d5827 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:18.084137 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-37859089-e5fa-43d8-a75a-eef1683d5827 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:18.092295 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-37859089-e5fa-43d8-a75a-eef1683d5827 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:18.092804 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-37859089-e5fa-43d8-a75a-eef1683d5827 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:18.093691 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-37859089-e5fa-43d8-a75a-eef1683d5827 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:18.095045 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-37859089-e5fa-43d8-a75a-eef1683d5827 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:18.290111 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-aaa9e7f7-8b5d-43a8-a38c-6ce41b66bbb1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:18.291329 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-aaa9e7f7-8b5d-43a8-a38c-6ce41b66bbb1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:18.300402 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-aaa9e7f7-8b5d-43a8-a38c-6ce41b66bbb1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:18.300938 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-aaa9e7f7-8b5d-43a8-a38c-6ce41b66bbb1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:18.301822 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-aaa9e7f7-8b5d-43a8-a38c-6ce41b66bbb1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:18.302330 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-aaa9e7f7-8b5d-43a8-a38c-6ce41b66bbb1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:18.326692 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-37859089-e5fa-43d8-a75a-eef1683d5827 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:18.337028 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-37859089-e5fa-43d8-a75a-eef1683d5827 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:18.338772 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-37859089-e5fa-43d8-a75a-eef1683d5827 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:18.340037 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-37859089-e5fa-43d8-a75a-eef1683d5827 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1599 microversion: 2.20 time: 0.261930 Apr 20 18:38:18.340696 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 408/826] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:38:18 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1599 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:38:18.353893 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a9ce09dc-9268-4685-ae85-b000d3f97564 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:18.354943 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a9ce09dc-9268-4685-ae85-b000d3f97564 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:18.364027 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a9ce09dc-9268-4685-ae85-b000d3f97564 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:18.364542 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a9ce09dc-9268-4685-ae85-b000d3f97564 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:18.365657 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a9ce09dc-9268-4685-ae85-b000d3f97564 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:18.366155 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a9ce09dc-9268-4685-ae85-b000d3f97564 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:18.460026 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-aaa9e7f7-8b5d-43a8-a38c-6ce41b66bbb1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 14 microversion: 2.1 time: 0.173995 Apr 20 18:38:18.463637 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 419/827] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:18 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 14 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 20 18:38:18.467312 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-df495d77-29a4-40b6-b12d-405034bd7760 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:18.467962 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-df495d77-29a4-40b6-b12d-405034bd7760 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:18.478090 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df495d77-29a4-40b6-b12d-405034bd7760 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:18.478616 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df495d77-29a4-40b6-b12d-405034bd7760 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:18.479475 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df495d77-29a4-40b6-b12d-405034bd7760 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:18.479997 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df495d77-29a4-40b6-b12d-405034bd7760 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:18.607436 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a9ce09dc-9268-4685-ae85-b000d3f97564 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:18.616572 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a9ce09dc-9268-4685-ae85-b000d3f97564 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 200 len: 1267 microversion: 2.1 time: 0.267119 Apr 20 18:38:18.617215 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 409/828] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:18 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 1267 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:38:18.651324 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-df495d77-29a4-40b6-b12d-405034bd7760 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.189001 Apr 20 18:38:18.652001 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 420/829] 10.222.0.25 () {60 vars in 1306 bytes} [Tue Apr 20 18:38:18 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/os-interface => generated 285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:18.899154 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0af06fe6-7624-41c5-84a5-5777e20b0439 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:18.899751 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0af06fe6-7624-41c5-84a5-5777e20b0439 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:18.909118 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0af06fe6-7624-41c5-84a5-5777e20b0439 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:18.909693 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0af06fe6-7624-41c5-84a5-5777e20b0439 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:18.910560 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0af06fe6-7624-41c5-84a5-5777e20b0439 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:18.911058 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0af06fe6-7624-41c5-84a5-5777e20b0439 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:19.168264 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0af06fe6-7624-41c5-84a5-5777e20b0439 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:19.187743 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0af06fe6-7624-41c5-84a5-5777e20b0439 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1357 microversion: 2.1 time: 0.292495 Apr 20 18:38:19.199845 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 410/830] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:18 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1357 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:19.473607 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-beb5b473-46dc-4a79-9247-e2cb0e3e8e7f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:19.474692 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-beb5b473-46dc-4a79-9247-e2cb0e3e8e7f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:19.487780 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-beb5b473-46dc-4a79-9247-e2cb0e3e8e7f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:19.488288 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-beb5b473-46dc-4a79-9247-e2cb0e3e8e7f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:19.489151 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-beb5b473-46dc-4a79-9247-e2cb0e3e8e7f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:19.489679 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-beb5b473-46dc-4a79-9247-e2cb0e3e8e7f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:19.623944 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-beb5b473-46dc-4a79-9247-e2cb0e3e8e7f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 14 microversion: 2.1 time: 0.155165 Apr 20 18:38:19.627811 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 421/831] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:19 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:38:19.635676 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-dd9af69b-34bd-4d0e-9e81-e8cf1d9062dd tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:19.636363 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-dd9af69b-34bd-4d0e-9e81-e8cf1d9062dd tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:19.645555 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dd9af69b-34bd-4d0e-9e81-e8cf1d9062dd tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:19.646085 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dd9af69b-34bd-4d0e-9e81-e8cf1d9062dd tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:19.646941 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dd9af69b-34bd-4d0e-9e81-e8cf1d9062dd tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:19.647437 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dd9af69b-34bd-4d0e-9e81-e8cf1d9062dd tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:19.884664 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-dd9af69b-34bd-4d0e-9e81-e8cf1d9062dd tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:19.895375 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-dd9af69b-34bd-4d0e-9e81-e8cf1d9062dd tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 200 len: 1267 microversion: 2.1 time: 0.263725 Apr 20 18:38:19.896041 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 411/832] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:19 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 1267 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:20.208807 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4e2cb327-4d5f-4c12-999a-ad052738a277 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:20.210852 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4e2cb327-4d5f-4c12-999a-ad052738a277 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:20.219872 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4e2cb327-4d5f-4c12-999a-ad052738a277 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:20.220375 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4e2cb327-4d5f-4c12-999a-ad052738a277 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:20.221222 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4e2cb327-4d5f-4c12-999a-ad052738a277 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:20.221761 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4e2cb327-4d5f-4c12-999a-ad052738a277 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:20.648051 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-817aa5b0-8141-4a78-960f-bc8031612755 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:20.650731 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-817aa5b0-8141-4a78-960f-bc8031612755 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:20.661126 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-817aa5b0-8141-4a78-960f-bc8031612755 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:20.661689 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-817aa5b0-8141-4a78-960f-bc8031612755 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:20.662564 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-817aa5b0-8141-4a78-960f-bc8031612755 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:20.663066 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-817aa5b0-8141-4a78-960f-bc8031612755 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:20.727000 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4e2cb327-4d5f-4c12-999a-ad052738a277 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:20.738618 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4e2cb327-4d5f-4c12-999a-ad052738a277 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1546 microversion: 2.1 time: 0.535619 Apr 20 18:38:20.739538 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 422/833] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:20 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1546 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:20.758107 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b76f64b8-b8c6-4837-8120-1af1a9788bde tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:20.759191 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b76f64b8-b8c6-4837-8120-1af1a9788bde tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:20.768866 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b76f64b8-b8c6-4837-8120-1af1a9788bde tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:20.769382 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b76f64b8-b8c6-4837-8120-1af1a9788bde tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:20.770274 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b76f64b8-b8c6-4837-8120-1af1a9788bde tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:20.770963 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b76f64b8-b8c6-4837-8120-1af1a9788bde tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:20.840837 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-817aa5b0-8141-4a78-960f-bc8031612755 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 14 microversion: 2.1 time: 0.202878 Apr 20 18:38:20.842462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 412/834] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:20 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 14 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:38:20.848887 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-a35e95c8-93aa-42b1-8871-3285b0de4ac0 req-fe8154e0-20c6-4554-a5ae-57deb6be9874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976", "tag": "c57f912b-2b41-47e1-bdd2-e6f469efb49c"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:20.850843 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:38:20.850843 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:38:20.861833 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-a35e95c8-93aa-42b1-8871-3285b0de4ac0 req-fe8154e0-20c6-4554-a5ae-57deb6be9874 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:20.862600 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-a35e95c8-93aa-42b1-8871-3285b0de4ac0 req-fe8154e0-20c6-4554-a5ae-57deb6be9874 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:20.886647 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-a35e95c8-93aa-42b1-8871-3285b0de4ac0 req-fe8154e0-20c6-4554-a5ae-57deb6be9874 service nova] Creating event network-changed:c57f912b-2b41-47e1-bdd2-e6f469efb49c for instance bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 on hv-cinder-78693 Apr 20 18:38:20.893749 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-a35e95c8-93aa-42b1-8871-3285b0de4ac0 req-fe8154e0-20c6-4554-a5ae-57deb6be9874 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049256 Apr 20 18:38:20.895045 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 413/835] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:38:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:38:20.902289 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-42782ed4-3368-406e-9da7-e5e598458186 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:20.903387 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-42782ed4-3368-406e-9da7-e5e598458186 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:20.915024 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-42782ed4-3368-406e-9da7-e5e598458186 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:20.916017 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-42782ed4-3368-406e-9da7-e5e598458186 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:20.916903 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-42782ed4-3368-406e-9da7-e5e598458186 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:20.917431 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-42782ed4-3368-406e-9da7-e5e598458186 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:20.919278 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b76f64b8-b8c6-4837-8120-1af1a9788bde tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 14 microversion: 2.20 time: 0.165973 Apr 20 18:38:20.920489 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 423/836] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:20 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:20.932258 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-72c78d9e-5c53-4240-86fc-4e1538a131fe tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:20.933174 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-72c78d9e-5c53-4240-86fc-4e1538a131fe tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:20.944390 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-72c78d9e-5c53-4240-86fc-4e1538a131fe tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:20.945611 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-72c78d9e-5c53-4240-86fc-4e1538a131fe tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:20.946993 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-72c78d9e-5c53-4240-86fc-4e1538a131fe tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:20.947587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-72c78d9e-5c53-4240-86fc-4e1538a131fe tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:21.231984 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-72c78d9e-5c53-4240-86fc-4e1538a131fe tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:21.245198 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-72c78d9e-5c53-4240-86fc-4e1538a131fe tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 200 len: 1267 microversion: 2.1 time: 0.318041 Apr 20 18:38:21.246264 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 424/837] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:20 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 1267 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:21.415619 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-42782ed4-3368-406e-9da7-e5e598458186 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:21.435029 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-42782ed4-3368-406e-9da7-e5e598458186 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1546 microversion: 2.1 time: 0.537852 Apr 20 18:38:21.449521 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 414/838] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:20 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1546 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:21.474812 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1dd2f2a4-0110-416b-bb93-156518e4ffad tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:21.485236 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:38:21.485236 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:38:21.487877 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1dd2f2a4-0110-416b-bb93-156518e4ffad tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:21.488808 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1dd2f2a4-0110-416b-bb93-156518e4ffad tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Searching by: {'deleted': False, 'project_id': 'e634dce05f2b45d593dfbca5940a886d'} {{(pid=100593) get_all /opt/stack/nova/nova/compute/api.py:2857}} Apr 20 18:38:21.498387 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1dd2f2a4-0110-416b-bb93-156518e4ffad tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:21.499548 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1dd2f2a4-0110-416b-bb93-156518e4ffad tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:21.502714 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1dd2f2a4-0110-416b-bb93-156518e4ffad tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:21.503840 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1dd2f2a4-0110-416b-bb93-156518e4ffad tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:21.735151 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.multi_cell_list [None req-1dd2f2a4-0110-416b-bb93-156518e4ffad tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=100593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Apr 20 18:38:21.857199 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a0d3d35a-7913-4e14-9a0e-3b54c56b091e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:21.858873 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a0d3d35a-7913-4e14-9a0e-3b54c56b091e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:21.884358 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a0d3d35a-7913-4e14-9a0e-3b54c56b091e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:21.884908 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a0d3d35a-7913-4e14-9a0e-3b54c56b091e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:21.885915 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a0d3d35a-7913-4e14-9a0e-3b54c56b091e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:21.886793 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a0d3d35a-7913-4e14-9a0e-3b54c56b091e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:22.036506 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1dd2f2a4-0110-416b-bb93-156518e4ffad tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.572985 Apr 20 18:38:22.037596 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 425/839] 10.222.0.25 () {58 vars in 1115 bytes} [Tue Apr 20 18:38:21 2021] GET /compute/v2.1/servers => generated 342 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:38:22.051984 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3cc618fe-55fd-4b9d-b3b6-57560f4ede00 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:22.055007 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a0d3d35a-7913-4e14-9a0e-3b54c56b091e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 7546 microversion: 2.1 time: 0.202580 Apr 20 18:38:22.056574 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3cc618fe-55fd-4b9d-b3b6-57560f4ede00 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:22.063027 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 415/840] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:21 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 7546 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:22.075660 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3cc618fe-55fd-4b9d-b3b6-57560f4ede00 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:22.076550 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3cc618fe-55fd-4b9d-b3b6-57560f4ede00 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:22.078989 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3cc618fe-55fd-4b9d-b3b6-57560f4ede00 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:22.082863 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3cc618fe-55fd-4b9d-b3b6-57560f4ede00 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:22.084658 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7ee151fa-78a7-4103-a51f-0ca43cbd4225 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:22.086514 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7ee151fa-78a7-4103-a51f-0ca43cbd4225 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:22.114075 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7ee151fa-78a7-4103-a51f-0ca43cbd4225 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:22.115911 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7ee151fa-78a7-4103-a51f-0ca43cbd4225 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:22.118148 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7ee151fa-78a7-4103-a51f-0ca43cbd4225 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:22.119345 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7ee151fa-78a7-4103-a51f-0ca43cbd4225 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:22.366632 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3cc618fe-55fd-4b9d-b3b6-57560f4ede00 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 14 microversion: 2.20 time: 0.327348 Apr 20 18:38:22.367253 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 426/841] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:22 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 14 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:22.373296 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e788cfeb-bc47-453c-a3ad-79c23ad03e14 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:22.374318 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e788cfeb-bc47-453c-a3ad-79c23ad03e14 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:22.384733 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e788cfeb-bc47-453c-a3ad-79c23ad03e14 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:22.385263 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e788cfeb-bc47-453c-a3ad-79c23ad03e14 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:22.386348 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e788cfeb-bc47-453c-a3ad-79c23ad03e14 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:22.386672 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e788cfeb-bc47-453c-a3ad-79c23ad03e14 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:22.712682 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e788cfeb-bc47-453c-a3ad-79c23ad03e14 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:22.714249 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7ee151fa-78a7-4103-a51f-0ca43cbd4225 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:22.725521 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e788cfeb-bc47-453c-a3ad-79c23ad03e14 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 200 len: 1267 microversion: 2.1 time: 0.356869 Apr 20 18:38:22.726556 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 427/842] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:22 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 1267 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:22.727240 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7ee151fa-78a7-4103-a51f-0ca43cbd4225 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1546 microversion: 2.1 time: 0.661441 Apr 20 18:38:22.728443 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 416/843] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:22 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1546 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:23.071791 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a44dcc5b-b21e-4d4b-95e1-fd998c62389b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:23.072991 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a44dcc5b-b21e-4d4b-95e1-fd998c62389b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:23.083082 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a44dcc5b-b21e-4d4b-95e1-fd998c62389b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:23.083748 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a44dcc5b-b21e-4d4b-95e1-fd998c62389b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:23.084701 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a44dcc5b-b21e-4d4b-95e1-fd998c62389b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:23.085285 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a44dcc5b-b21e-4d4b-95e1-fd998c62389b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:23.256476 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a44dcc5b-b21e-4d4b-95e1-fd998c62389b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 15025 microversion: 2.1 time: 0.188963 Apr 20 18:38:23.260748 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 428/844] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:23 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 15025 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:23.382238 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6f83b8fa-ed01-4900-a137-322daf4f6017 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:23.383485 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6f83b8fa-ed01-4900-a137-322daf4f6017 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:23.402982 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6f83b8fa-ed01-4900-a137-322daf4f6017 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:23.403502 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6f83b8fa-ed01-4900-a137-322daf4f6017 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:23.404373 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6f83b8fa-ed01-4900-a137-322daf4f6017 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:23.404928 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6f83b8fa-ed01-4900-a137-322daf4f6017 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:23.552928 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6f83b8fa-ed01-4900-a137-322daf4f6017 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 14 microversion: 2.20 time: 0.177766 Apr 20 18:38:23.554099 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 417/845] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:23 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:23.752697 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0ee7c847-ac90-4fe0-b084-9c07182a7663 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:23.753433 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0ee7c847-ac90-4fe0-b084-9c07182a7663 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:23.762465 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0ee7c847-ac90-4fe0-b084-9c07182a7663 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:23.762978 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0ee7c847-ac90-4fe0-b084-9c07182a7663 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:23.763842 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0ee7c847-ac90-4fe0-b084-9c07182a7663 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:23.764343 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0ee7c847-ac90-4fe0-b084-9c07182a7663 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:24.002408 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0ee7c847-ac90-4fe0-b084-9c07182a7663 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:24.012035 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0ee7c847-ac90-4fe0-b084-9c07182a7663 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 200 len: 1267 microversion: 2.1 time: 0.264733 Apr 20 18:38:24.012588 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 429/846] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:23 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 1267 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:24.270295 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7d7a6bb7-bcd4-4fd3-9ae4-c09f801303fe tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:24.271476 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7d7a6bb7-bcd4-4fd3-9ae4-c09f801303fe tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:24.280708 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7d7a6bb7-bcd4-4fd3-9ae4-c09f801303fe tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:24.281215 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7d7a6bb7-bcd4-4fd3-9ae4-c09f801303fe tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:24.282852 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7d7a6bb7-bcd4-4fd3-9ae4-c09f801303fe tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:24.283352 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7d7a6bb7-bcd4-4fd3-9ae4-c09f801303fe tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:24.431874 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7d7a6bb7-bcd4-4fd3-9ae4-c09f801303fe tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 17861 microversion: 2.1 time: 0.166670 Apr 20 18:38:24.438735 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 418/847] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:24 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 17861 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:38:24.567197 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-26f8b2ff-4bac-43b7-beca-50c2e4c20d11 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:24.569009 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-26f8b2ff-4bac-43b7-beca-50c2e4c20d11 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:24.604495 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-26f8b2ff-4bac-43b7-beca-50c2e4c20d11 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:24.605596 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-26f8b2ff-4bac-43b7-beca-50c2e4c20d11 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:24.606943 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-26f8b2ff-4bac-43b7-beca-50c2e4c20d11 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:24.608297 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-26f8b2ff-4bac-43b7-beca-50c2e4c20d11 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:24.698422 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-aaecb522-b337-4575-98c7-7da5f34af95e req-e153c9e9-e264-4024-8733-29e3b3d3de40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e41ddc-6fad-4179-8d1b-55e8bc4044c8", "name": "network-vif-plugged", "status": "completed", "tag": "4fda7bf6-0fcd-4ef5-b14d-d4ef76e12de0"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:24.700803 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:38:24.700803 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:38:24.713464 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-aaecb522-b337-4575-98c7-7da5f34af95e req-e153c9e9-e264-4024-8733-29e3b3d3de40 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:24.713992 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-aaecb522-b337-4575-98c7-7da5f34af95e req-e153c9e9-e264-4024-8733-29e3b3d3de40 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:24.734136 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-aaecb522-b337-4575-98c7-7da5f34af95e req-e153c9e9-e264-4024-8733-29e3b3d3de40 service nova] Creating event network-vif-plugged:4fda7bf6-0fcd-4ef5-b14d-d4ef76e12de0 for instance f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 on hv-cinder-78693 Apr 20 18:38:24.741964 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-26f8b2ff-4bac-43b7-beca-50c2e4c20d11 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 14 microversion: 2.20 time: 0.180610 Apr 20 18:38:24.742586 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-aaecb522-b337-4575-98c7-7da5f34af95e req-e153c9e9-e264-4024-8733-29e3b3d3de40 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048795 Apr 20 18:38:24.742981 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 430/848] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:24 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:38:24.746203 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 419/849] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:38:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:38:24.901723 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b76392a1-833d-41dc-8cf0-da9bed8db3a4 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc1d7102-18df-4078-88e1-2fbc76baaff5"}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:24.903054 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b76392a1-833d-41dc-8cf0-da9bed8db3a4 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:24.914036 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b76392a1-833d-41dc-8cf0-da9bed8db3a4 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:24.914767 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b76392a1-833d-41dc-8cf0-da9bed8db3a4 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:24.915533 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b76392a1-833d-41dc-8cf0-da9bed8db3a4 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:24.916277 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b76392a1-833d-41dc-8cf0-da9bed8db3a4 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:25.031073 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-43b6601c-b9f3-4a37-b1d1-d798f68e4fb3 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:25.032315 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-43b6601c-b9f3-4a37-b1d1-d798f68e4fb3 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:25.041246 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-43b6601c-b9f3-4a37-b1d1-d798f68e4fb3 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:25.041791 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-43b6601c-b9f3-4a37-b1d1-d798f68e4fb3 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:25.042644 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-43b6601c-b9f3-4a37-b1d1-d798f68e4fb3 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:25.043189 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-43b6601c-b9f3-4a37-b1d1-d798f68e4fb3 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:25.349053 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-43b6601c-b9f3-4a37-b1d1-d798f68e4fb3 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:25.358947 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-43b6601c-b9f3-4a37-b1d1-d798f68e4fb3 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 200 len: 1267 microversion: 2.1 time: 0.332374 Apr 20 18:38:25.359733 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 420/850] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:25 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 1267 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:38:25.365411 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b76392a1-833d-41dc-8cf0-da9bed8db3a4 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "POST /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.468156 Apr 20 18:38:25.366150 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 431/851] 10.222.0.25 () {60 vars in 1313 bytes} [Tue Apr 20 18:38:24 2021] POST /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59/os-volume_attachments => generated 194 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:38:25.451580 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6e67bcff-f3eb-4a23-8514-6b89dd792403 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:25.454017 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6e67bcff-f3eb-4a23-8514-6b89dd792403 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:25.467078 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6e67bcff-f3eb-4a23-8514-6b89dd792403 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:25.467694 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6e67bcff-f3eb-4a23-8514-6b89dd792403 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:25.468622 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6e67bcff-f3eb-4a23-8514-6b89dd792403 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:25.469600 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6e67bcff-f3eb-4a23-8514-6b89dd792403 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:25.754402 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-29369438-d9d9-4cfe-b89d-ce921725c586 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:25.755651 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-29369438-d9d9-4cfe-b89d-ce921725c586 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:25.763340 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6e67bcff-f3eb-4a23-8514-6b89dd792403 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 19661 microversion: 2.1 time: 0.318900 Apr 20 18:38:25.765125 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 421/852] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:25 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 19661 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:25.768494 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29369438-d9d9-4cfe-b89d-ce921725c586 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:25.769011 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29369438-d9d9-4cfe-b89d-ce921725c586 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:25.769903 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29369438-d9d9-4cfe-b89d-ce921725c586 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:25.770398 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29369438-d9d9-4cfe-b89d-ce921725c586 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:25.925928 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-29369438-d9d9-4cfe-b89d-ce921725c586 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 14 microversion: 2.20 time: 0.176622 Apr 20 18:38:25.929541 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 432/853] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:25 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:26.381524 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d36a83d7-bdfd-4577-a18e-a79890fea269 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:26.382574 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d36a83d7-bdfd-4577-a18e-a79890fea269 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:26.392666 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d36a83d7-bdfd-4577-a18e-a79890fea269 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:26.393277 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d36a83d7-bdfd-4577-a18e-a79890fea269 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:26.394284 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d36a83d7-bdfd-4577-a18e-a79890fea269 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:26.394790 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d36a83d7-bdfd-4577-a18e-a79890fea269 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:26.686626 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d36a83d7-bdfd-4577-a18e-a79890fea269 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:26.707605 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d36a83d7-bdfd-4577-a18e-a79890fea269 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 200 len: 1267 microversion: 2.1 time: 0.330739 Apr 20 18:38:26.721451 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 422/854] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:26 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 1267 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:26.778831 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2ad2f0ee-9386-48c0-a853-bb43590b81db tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:26.780233 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2ad2f0ee-9386-48c0-a853-bb43590b81db tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:26.790005 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2ad2f0ee-9386-48c0-a853-bb43590b81db tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:26.790583 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2ad2f0ee-9386-48c0-a853-bb43590b81db tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:26.791548 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2ad2f0ee-9386-48c0-a853-bb43590b81db tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:26.792105 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2ad2f0ee-9386-48c0-a853-bb43590b81db tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:26.938361 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ce469d6a-cdab-417f-8c37-a72541e1c5d8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:26.940128 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ce469d6a-cdab-417f-8c37-a72541e1c5d8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:26.943410 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2ad2f0ee-9386-48c0-a853-bb43590b81db tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 22064 microversion: 2.1 time: 0.169553 Apr 20 18:38:26.947758 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 433/855] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:26 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 22064 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:26.948673 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ce469d6a-cdab-417f-8c37-a72541e1c5d8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:26.949180 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ce469d6a-cdab-417f-8c37-a72541e1c5d8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:26.950832 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ce469d6a-cdab-417f-8c37-a72541e1c5d8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:26.951564 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ce469d6a-cdab-417f-8c37-a72541e1c5d8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:27.092731 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ce469d6a-cdab-417f-8c37-a72541e1c5d8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 14 microversion: 2.20 time: 0.159573 Apr 20 18:38:27.093606 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 423/856] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:26 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:38:27.739206 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f7c0a393-c7d7-47dc-94ba-890c35e6f53b tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:27.740766 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f7c0a393-c7d7-47dc-94ba-890c35e6f53b tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:27.756226 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f7c0a393-c7d7-47dc-94ba-890c35e6f53b tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:27.757312 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f7c0a393-c7d7-47dc-94ba-890c35e6f53b tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:27.758651 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f7c0a393-c7d7-47dc-94ba-890c35e6f53b tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:27.759306 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f7c0a393-c7d7-47dc-94ba-890c35e6f53b tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:27.958206 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-167d78b9-4d4f-4970-80b2-f208f6f3bca2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:27.959401 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-167d78b9-4d4f-4970-80b2-f208f6f3bca2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:27.980248 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-167d78b9-4d4f-4970-80b2-f208f6f3bca2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:27.980837 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-167d78b9-4d4f-4970-80b2-f208f6f3bca2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:27.981609 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-167d78b9-4d4f-4970-80b2-f208f6f3bca2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:27.982115 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-167d78b9-4d4f-4970-80b2-f208f6f3bca2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:28.116694 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-167d78b9-4d4f-4970-80b2-f208f6f3bca2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 23214 microversion: 2.1 time: 0.164266 Apr 20 18:38:28.118158 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 424/857] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:27 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 23214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:28.127168 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b5a2269b-2a07-405e-9a2f-8d545145dfd8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:28.128307 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b5a2269b-2a07-405e-9a2f-8d545145dfd8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:28.137677 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b5a2269b-2a07-405e-9a2f-8d545145dfd8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:28.138256 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b5a2269b-2a07-405e-9a2f-8d545145dfd8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:28.139163 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b5a2269b-2a07-405e-9a2f-8d545145dfd8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:28.139857 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b5a2269b-2a07-405e-9a2f-8d545145dfd8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:28.148430 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f7c0a393-c7d7-47dc-94ba-890c35e6f53b tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:28.157941 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f7c0a393-c7d7-47dc-94ba-890c35e6f53b tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 200 len: 1455 microversion: 2.1 time: 0.427469 Apr 20 18:38:28.158606 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 434/858] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:27 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 1455 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:28.183665 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6ebbfeec-b850-4be8-a2ad-56ea522b943f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:28.184336 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6ebbfeec-b850-4be8-a2ad-56ea522b943f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:28.193294 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6ebbfeec-b850-4be8-a2ad-56ea522b943f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:28.193837 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6ebbfeec-b850-4be8-a2ad-56ea522b943f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:28.194724 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6ebbfeec-b850-4be8-a2ad-56ea522b943f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:28.195220 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6ebbfeec-b850-4be8-a2ad-56ea522b943f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:28.274405 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b5a2269b-2a07-405e-9a2f-8d545145dfd8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 14 microversion: 2.20 time: 0.155351 Apr 20 18:38:28.278487 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 425/859] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:28 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:28.454054 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6ebbfeec-b850-4be8-a2ad-56ea522b943f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:28.463561 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6ebbfeec-b850-4be8-a2ad-56ea522b943f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 200 len: 1455 microversion: 2.1 time: 0.283997 Apr 20 18:38:28.464226 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 435/860] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:28 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 1455 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:38:29.130512 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-df783ec4-9190-4491-8d05-6b0a28f3a69d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:29.131668 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-df783ec4-9190-4491-8d05-6b0a28f3a69d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:29.141452 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df783ec4-9190-4491-8d05-6b0a28f3a69d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:29.141957 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df783ec4-9190-4491-8d05-6b0a28f3a69d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:29.142829 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df783ec4-9190-4491-8d05-6b0a28f3a69d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:29.143323 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-df783ec4-9190-4491-8d05-6b0a28f3a69d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:29.287526 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0ccad9ed-b83b-412e-a1c9-22c314d2f601 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:29.288665 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0ccad9ed-b83b-412e-a1c9-22c314d2f601 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:29.297376 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0ccad9ed-b83b-412e-a1c9-22c314d2f601 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:29.297914 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0ccad9ed-b83b-412e-a1c9-22c314d2f601 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:29.298772 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0ccad9ed-b83b-412e-a1c9-22c314d2f601 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:29.299273 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0ccad9ed-b83b-412e-a1c9-22c314d2f601 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:29.300796 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-df783ec4-9190-4491-8d05-6b0a28f3a69d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 24882 microversion: 2.1 time: 0.175195 Apr 20 18:38:29.302586 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 426/861] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:29 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 24882 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:29.425368 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0ccad9ed-b83b-412e-a1c9-22c314d2f601 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 14 microversion: 2.20 time: 0.142686 Apr 20 18:38:29.426281 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 436/862] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:29 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:30.315145 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-13cf5a14-181a-43bd-a610-5a1f92a82839 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:30.317010 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-13cf5a14-181a-43bd-a610-5a1f92a82839 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:30.326220 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-13cf5a14-181a-43bd-a610-5a1f92a82839 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:30.326738 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-13cf5a14-181a-43bd-a610-5a1f92a82839 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:30.327621 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-13cf5a14-181a-43bd-a610-5a1f92a82839 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:30.328731 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-13cf5a14-181a-43bd-a610-5a1f92a82839 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:30.443658 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7bc37edf-73f5-4cf7-aebe-cd5b93da5790 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:30.446231 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7bc37edf-73f5-4cf7-aebe-cd5b93da5790 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:30.464290 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7bc37edf-73f5-4cf7-aebe-cd5b93da5790 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:30.465166 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7bc37edf-73f5-4cf7-aebe-cd5b93da5790 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:30.466813 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7bc37edf-73f5-4cf7-aebe-cd5b93da5790 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:30.467717 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7bc37edf-73f5-4cf7-aebe-cd5b93da5790 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:30.512630 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-13cf5a14-181a-43bd-a610-5a1f92a82839 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 26331 microversion: 2.1 time: 0.202711 Apr 20 18:38:30.513547 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 427/863] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:30 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 26331 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:30.664438 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7bc37edf-73f5-4cf7-aebe-cd5b93da5790 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 14 microversion: 2.20 time: 0.230846 Apr 20 18:38:30.670206 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 437/864] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:30 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 14 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:38:31.529254 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-570a9c67-77b0-446e-8155-b7d000f162f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:31.534911 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-a8044a4a-ea69-4efa-bd9d-3e6447a25e13 req-154a3f99-385f-4bd0-a0b2-fe3e6e570ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4e41ddc-6fad-4179-8d1b-55e8bc4044c8", "tag": "4fda7bf6-0fcd-4ef5-b14d-d4ef76e12de0"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:31.536449 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-570a9c67-77b0-446e-8155-b7d000f162f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:31.543131 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:38:31.543131 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:38:31.553284 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-570a9c67-77b0-446e-8155-b7d000f162f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:31.555471 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-570a9c67-77b0-446e-8155-b7d000f162f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:31.556369 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-570a9c67-77b0-446e-8155-b7d000f162f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:31.556870 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-570a9c67-77b0-446e-8155-b7d000f162f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:31.557733 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-a8044a4a-ea69-4efa-bd9d-3e6447a25e13 req-154a3f99-385f-4bd0-a0b2-fe3e6e570ec1 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:31.558251 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-a8044a4a-ea69-4efa-bd9d-3e6447a25e13 req-154a3f99-385f-4bd0-a0b2-fe3e6e570ec1 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:31.578324 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-a8044a4a-ea69-4efa-bd9d-3e6447a25e13 req-154a3f99-385f-4bd0-a0b2-fe3e6e570ec1 service nova] Creating event network-changed:4fda7bf6-0fcd-4ef5-b14d-d4ef76e12de0 for instance f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 on hv-cinder-78693 Apr 20 18:38:31.583838 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-a8044a4a-ea69-4efa-bd9d-3e6447a25e13 req-154a3f99-385f-4bd0-a0b2-fe3e6e570ec1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053452 Apr 20 18:38:31.584748 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 428/865] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:38:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:38:31.680009 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-acc335ab-d1a0-4aff-b3f1-35b809c25575 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:31.681080 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-acc335ab-d1a0-4aff-b3f1-35b809c25575 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:31.690263 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-acc335ab-d1a0-4aff-b3f1-35b809c25575 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:31.690783 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-acc335ab-d1a0-4aff-b3f1-35b809c25575 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:31.691694 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-acc335ab-d1a0-4aff-b3f1-35b809c25575 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:31.692193 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-acc335ab-d1a0-4aff-b3f1-35b809c25575 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:31.703950 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-570a9c67-77b0-446e-8155-b7d000f162f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 27307 microversion: 2.1 time: 0.179042 Apr 20 18:38:31.709285 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 438/866] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:31 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 27307 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:31.837945 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-acc335ab-d1a0-4aff-b3f1-35b809c25575 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 14 microversion: 2.20 time: 0.162471 Apr 20 18:38:31.839195 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 429/867] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:31 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:38:32.717818 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-294ceca5-4180-4931-bfd8-af179051f74d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:32.719505 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-294ceca5-4180-4931-bfd8-af179051f74d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:32.728929 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-294ceca5-4180-4931-bfd8-af179051f74d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:32.729482 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-294ceca5-4180-4931-bfd8-af179051f74d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:32.730347 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-294ceca5-4180-4931-bfd8-af179051f74d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:32.730838 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-294ceca5-4180-4931-bfd8-af179051f74d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:32.852234 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-61638da9-f0d7-4c7e-9931-73716b3eb0f2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:32.853698 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-61638da9-f0d7-4c7e-9931-73716b3eb0f2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:32.863391 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-61638da9-f0d7-4c7e-9931-73716b3eb0f2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:32.863934 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-61638da9-f0d7-4c7e-9931-73716b3eb0f2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:32.864928 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-61638da9-f0d7-4c7e-9931-73716b3eb0f2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:32.865473 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-61638da9-f0d7-4c7e-9931-73716b3eb0f2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:32.893522 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-294ceca5-4180-4931-bfd8-af179051f74d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 27664 microversion: 2.1 time: 0.180293 Apr 20 18:38:32.895625 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 439/868] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:32 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 27664 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:33.011414 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-61638da9-f0d7-4c7e-9931-73716b3eb0f2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 9137 microversion: 2.20 time: 0.164338 Apr 20 18:38:33.012161 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 430/869] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:32 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 9137 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:38:33.787785 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-081f5360-66e1-4290-9c5e-ca6aa603f8d6 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:33.789519 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-081f5360-66e1-4290-9c5e-ca6aa603f8d6 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:33.797489 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-081f5360-66e1-4290-9c5e-ca6aa603f8d6 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:33.797998 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-081f5360-66e1-4290-9c5e-ca6aa603f8d6 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:33.798846 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-081f5360-66e1-4290-9c5e-ca6aa603f8d6 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:33.799329 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-081f5360-66e1-4290-9c5e-ca6aa603f8d6 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:33.910361 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1cec3a9b-be2b-49ac-bb26-aeaaad148bb7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:33.911541 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1cec3a9b-be2b-49ac-bb26-aeaaad148bb7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:33.920683 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1cec3a9b-be2b-49ac-bb26-aeaaad148bb7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:33.921197 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1cec3a9b-be2b-49ac-bb26-aeaaad148bb7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:33.922138 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1cec3a9b-be2b-49ac-bb26-aeaaad148bb7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:33.922638 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1cec3a9b-be2b-49ac-bb26-aeaaad148bb7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:34.028657 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-081f5360-66e1-4290-9c5e-ca6aa603f8d6 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:34.040109 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-081f5360-66e1-4290-9c5e-ca6aa603f8d6 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1592 microversion: 2.1 time: 0.257006 Apr 20 18:38:34.040773 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 440/870] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:33 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1592 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:34.045830 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f7f4eb92-3010-4501-b2af-91eb8baee90d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:34.047082 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f7f4eb92-3010-4501-b2af-91eb8baee90d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:34.055502 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb92-3010-4501-b2af-91eb8baee90d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:34.056020 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb92-3010-4501-b2af-91eb8baee90d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:34.056880 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb92-3010-4501-b2af-91eb8baee90d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:34.057384 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f7f4eb92-3010-4501-b2af-91eb8baee90d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:34.077735 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1cec3a9b-be2b-49ac-bb26-aeaaad148bb7 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 27974 microversion: 2.1 time: 0.172384 Apr 20 18:38:34.079503 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 431/871] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:33 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 27974 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:34.219823 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f7f4eb92-3010-4501-b2af-91eb8baee90d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 15064 microversion: 2.20 time: 0.177433 Apr 20 18:38:34.220540 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 441/872] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:34 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 15064 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:38:35.092581 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-03e117fb-2e7b-4499-8622-da7bb4438ede tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:35.094466 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-03e117fb-2e7b-4499-8622-da7bb4438ede tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:35.108205 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-03e117fb-2e7b-4499-8622-da7bb4438ede tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:35.108688 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-03e117fb-2e7b-4499-8622-da7bb4438ede tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:35.110467 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-03e117fb-2e7b-4499-8622-da7bb4438ede tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:35.110975 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-03e117fb-2e7b-4499-8622-da7bb4438ede tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:35.233503 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7cfb3f56-c2dd-48d7-8c7b-3a6b3862bbfe tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:35.235257 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7cfb3f56-c2dd-48d7-8c7b-3a6b3862bbfe tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:35.244236 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7cfb3f56-c2dd-48d7-8c7b-3a6b3862bbfe tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:35.244844 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7cfb3f56-c2dd-48d7-8c7b-3a6b3862bbfe tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:35.245976 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7cfb3f56-c2dd-48d7-8c7b-3a6b3862bbfe tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:35.246266 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7cfb3f56-c2dd-48d7-8c7b-3a6b3862bbfe tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:35.259240 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-03e117fb-2e7b-4499-8622-da7bb4438ede tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 28210 microversion: 2.1 time: 0.171144 Apr 20 18:38:35.260123 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 432/873] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:35 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 28210 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:35.378940 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7cfb3f56-c2dd-48d7-8c7b-3a6b3862bbfe tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 18305 microversion: 2.20 time: 0.149689 Apr 20 18:38:35.379789 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 442/874] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:35 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 18305 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:38:36.273282 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c43365b5-b24f-420a-9a2b-f0bc824214b0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:36.274465 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c43365b5-b24f-420a-9a2b-f0bc824214b0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:36.283850 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c43365b5-b24f-420a-9a2b-f0bc824214b0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:36.284360 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c43365b5-b24f-420a-9a2b-f0bc824214b0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:36.285241 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c43365b5-b24f-420a-9a2b-f0bc824214b0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:36.286062 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c43365b5-b24f-420a-9a2b-f0bc824214b0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:36.394628 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-08cdc82a-28ee-476c-aa3e-2423c52ac221 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:36.396506 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-08cdc82a-28ee-476c-aa3e-2423c52ac221 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:36.412328 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-08cdc82a-28ee-476c-aa3e-2423c52ac221 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:36.413151 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-08cdc82a-28ee-476c-aa3e-2423c52ac221 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:36.414695 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-08cdc82a-28ee-476c-aa3e-2423c52ac221 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:36.415704 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-08cdc82a-28ee-476c-aa3e-2423c52ac221 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:36.455395 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c43365b5-b24f-420a-9a2b-f0bc824214b0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 28337 microversion: 2.1 time: 0.185255 Apr 20 18:38:36.457131 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 433/875] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:36 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 28337 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:36.570224 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-08cdc82a-28ee-476c-aa3e-2423c52ac221 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 19342 microversion: 2.20 time: 0.181759 Apr 20 18:38:36.570954 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 443/876] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:36 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 19342 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:38:37.050283 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-913d574e-325a-412a-b7ee-36ca5afca6e7 req-14c77b9c-b304-4ab0-a3f7-87ef7fa4da72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fa521e9-06dd-4516-8413-ce388953fe59", "tag": "d5b99ffe-cbe8-42b3-8e44-5a3598c73540"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:37.051722 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:38:37.051722 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:38:37.061788 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-913d574e-325a-412a-b7ee-36ca5afca6e7 req-14c77b9c-b304-4ab0-a3f7-87ef7fa4da72 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:37.062332 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-913d574e-325a-412a-b7ee-36ca5afca6e7 req-14c77b9c-b304-4ab0-a3f7-87ef7fa4da72 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:37.081569 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-913d574e-325a-412a-b7ee-36ca5afca6e7 req-14c77b9c-b304-4ab0-a3f7-87ef7fa4da72 service nova] Creating event network-changed:d5b99ffe-cbe8-42b3-8e44-5a3598c73540 for instance 4fa521e9-06dd-4516-8413-ce388953fe59 on hv-cinder-78693 Apr 20 18:38:37.086878 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-913d574e-325a-412a-b7ee-36ca5afca6e7 req-14c77b9c-b304-4ab0-a3f7-87ef7fa4da72 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042176 Apr 20 18:38:37.087828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 434/877] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:38:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:38:37.470977 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4ca8e1c8-4f4d-445e-a8be-e25eb6d31ada tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:37.473248 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4ca8e1c8-4f4d-445e-a8be-e25eb6d31ada tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:37.483647 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4ca8e1c8-4f4d-445e-a8be-e25eb6d31ada tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:37.485059 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4ca8e1c8-4f4d-445e-a8be-e25eb6d31ada tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:37.486196 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4ca8e1c8-4f4d-445e-a8be-e25eb6d31ada tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:37.486925 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4ca8e1c8-4f4d-445e-a8be-e25eb6d31ada tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:37.589790 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-95e5b31d-244b-40ae-a397-a58af269b7a2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:37.601692 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-95e5b31d-244b-40ae-a397-a58af269b7a2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:37.620762 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-95e5b31d-244b-40ae-a397-a58af269b7a2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:37.622070 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-95e5b31d-244b-40ae-a397-a58af269b7a2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:37.623395 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-95e5b31d-244b-40ae-a397-a58af269b7a2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:37.624238 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-95e5b31d-244b-40ae-a397-a58af269b7a2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:37.661129 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4ca8e1c8-4f4d-445e-a8be-e25eb6d31ada tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 28501 microversion: 2.1 time: 0.195890 Apr 20 18:38:37.662830 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 444/878] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:37 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 28501 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:37.778682 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-95e5b31d-244b-40ae-a397-a58af269b7a2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 22021 microversion: 2.20 time: 0.193700 Apr 20 18:38:37.784318 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 435/879] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:37 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 22021 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:38:38.653700 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-137690fe-bbbf-400f-84a9-e4300f4d0c0e tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1695079605"}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:38.655003 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-137690fe-bbbf-400f-84a9-e4300f4d0c0e tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:38.668977 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-137690fe-bbbf-400f-84a9-e4300f4d0c0e tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:38.669766 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-137690fe-bbbf-400f-84a9-e4300f4d0c0e tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:38.670658 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-137690fe-bbbf-400f-84a9-e4300f4d0c0e tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:38.671154 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-137690fe-bbbf-400f-84a9-e4300f4d0c0e tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:38.676828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-aebe0cd5-f609-4b25-a26b-6f058ad37734 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:38.678570 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-aebe0cd5-f609-4b25-a26b-6f058ad37734 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:38.688529 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-aebe0cd5-f609-4b25-a26b-6f058ad37734 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:38.689090 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-aebe0cd5-f609-4b25-a26b-6f058ad37734 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:38.690099 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-aebe0cd5-f609-4b25-a26b-6f058ad37734 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:38.690607 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-aebe0cd5-f609-4b25-a26b-6f058ad37734 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:38.836575 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-aebe0cd5-f609-4b25-a26b-6f058ad37734 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 28669 microversion: 2.1 time: 0.164943 Apr 20 18:38:38.841820 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 436/880] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:38 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 28669 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:38.848200 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b0c9f114-87d5-4e86-9045-90b9287df382 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:38.849522 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b0c9f114-87d5-4e86-9045-90b9287df382 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:38.858735 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b0c9f114-87d5-4e86-9045-90b9287df382 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:38.859357 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b0c9f114-87d5-4e86-9045-90b9287df382 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:38.860479 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b0c9f114-87d5-4e86-9045-90b9287df382 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:38.861063 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b0c9f114-87d5-4e86-9045-90b9287df382 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:38.899718 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.network.security_group_api [None req-137690fe-bbbf-400f-84a9-e4300f4d0c0e tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Adding security group 062979a9-6a2d-4e09-aa3d-aa99d4897cdf to port d5b99ffe-cbe8-42b3-8e44-5a3598c73540 Apr 20 18:38:39.010540 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b0c9f114-87d5-4e86-9045-90b9287df382 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 23442 microversion: 2.20 time: 0.166854 Apr 20 18:38:39.014998 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 437/881] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:38 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 23442 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:38:39.461200 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-137690fe-bbbf-400f-84a9-e4300f4d0c0e tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "POST /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59/action" status: 202 len: 0 microversion: 2.1 time: 0.816506 Apr 20 18:38:39.462716 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 445/882] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:38 2021] POST /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59/action => generated 0 bytes in 820 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:38:39.473628 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7353820e-d934-4601-8809-2ce650ea2885 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:39.474733 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7353820e-d934-4601-8809-2ce650ea2885 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:39.485774 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7353820e-d934-4601-8809-2ce650ea2885 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:39.486576 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7353820e-d934-4601-8809-2ce650ea2885 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:39.487991 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7353820e-d934-4601-8809-2ce650ea2885 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:39.488332 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-7358e903-7530-4179-a4c5-5d67a73a46ea req-f5185af8-397b-419f-b9c6-81f1be24f6dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fa521e9-06dd-4516-8413-ce388953fe59", "tag": "d5b99ffe-cbe8-42b3-8e44-5a3598c73540"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:39.488872 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7353820e-d934-4601-8809-2ce650ea2885 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:39.490444 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:38:39.490444 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:38:39.502641 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-7358e903-7530-4179-a4c5-5d67a73a46ea req-f5185af8-397b-419f-b9c6-81f1be24f6dd service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:39.503581 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-7358e903-7530-4179-a4c5-5d67a73a46ea req-f5185af8-397b-419f-b9c6-81f1be24f6dd service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:39.527440 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-7358e903-7530-4179-a4c5-5d67a73a46ea req-f5185af8-397b-419f-b9c6-81f1be24f6dd service nova] Creating event network-changed:d5b99ffe-cbe8-42b3-8e44-5a3598c73540 for instance 4fa521e9-06dd-4516-8413-ce388953fe59 on hv-cinder-78693 Apr 20 18:38:39.538366 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-7358e903-7530-4179-a4c5-5d67a73a46ea req-f5185af8-397b-419f-b9c6-81f1be24f6dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056204 Apr 20 18:38:39.540120 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 446/883] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:38:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:38:39.853258 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b49e78fa-1ab5-4a26-98ec-6e7e803024b2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:39.854677 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b49e78fa-1ab5-4a26-98ec-6e7e803024b2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:39.865260 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b49e78fa-1ab5-4a26-98ec-6e7e803024b2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:39.866234 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b49e78fa-1ab5-4a26-98ec-6e7e803024b2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:39.867331 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b49e78fa-1ab5-4a26-98ec-6e7e803024b2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:39.867941 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b49e78fa-1ab5-4a26-98ec-6e7e803024b2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:39.979436 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7353820e-d934-4601-8809-2ce650ea2885 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:38:39.991189 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7353820e-d934-4601-8809-2ce650ea2885 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1758 microversion: 2.1 time: 0.522873 Apr 20 18:38:39.991848 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 438/884] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:38:39 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1758 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:38:40.023253 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b49e78fa-1ab5-4a26-98ec-6e7e803024b2 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 28669 microversion: 2.1 time: 0.177118 Apr 20 18:38:40.024034 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-797db47e-8f40-4aba-a1ff-6a5de3c14217 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:40.028096 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 447/885] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:39 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 28669 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:38:40.028332 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-797db47e-8f40-4aba-a1ff-6a5de3c14217 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:40.034883 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-797db47e-8f40-4aba-a1ff-6a5de3c14217 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:40.035480 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-797db47e-8f40-4aba-a1ff-6a5de3c14217 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:40.036420 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-797db47e-8f40-4aba-a1ff-6a5de3c14217 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:40.037029 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-797db47e-8f40-4aba-a1ff-6a5de3c14217 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:40.190021 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-797db47e-8f40-4aba-a1ff-6a5de3c14217 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 24694 microversion: 2.20 time: 0.170328 Apr 20 18:38:40.190763 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 439/886] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:40 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 24694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:38:41.037354 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5d95f4e5-515d-4da8-95ad-004a0678415b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:41.038608 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5d95f4e5-515d-4da8-95ad-004a0678415b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:41.048743 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5d95f4e5-515d-4da8-95ad-004a0678415b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:41.049261 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5d95f4e5-515d-4da8-95ad-004a0678415b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:41.050231 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5d95f4e5-515d-4da8-95ad-004a0678415b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:41.050735 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5d95f4e5-515d-4da8-95ad-004a0678415b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:41.184857 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5d95f4e5-515d-4da8-95ad-004a0678415b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 28669 microversion: 2.1 time: 0.151930 Apr 20 18:38:41.185665 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 448/887] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:41 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 28669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:41.206687 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ff1a0e90-e1f3-4f86-bcf1-58602e39d8c9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:41.208292 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ff1a0e90-e1f3-4f86-bcf1-58602e39d8c9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:41.220805 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ff1a0e90-e1f3-4f86-bcf1-58602e39d8c9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:41.221318 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ff1a0e90-e1f3-4f86-bcf1-58602e39d8c9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:41.222223 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ff1a0e90-e1f3-4f86-bcf1-58602e39d8c9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:41.222877 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ff1a0e90-e1f3-4f86-bcf1-58602e39d8c9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:41.392133 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ff1a0e90-e1f3-4f86-bcf1-58602e39d8c9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 25767 microversion: 2.20 time: 0.191323 Apr 20 18:38:41.392981 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 440/888] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:41 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 25767 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:38:42.199656 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-89eea33d-7e3c-4d6b-9dfa-4a5cea0923bf tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:42.200869 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-89eea33d-7e3c-4d6b-9dfa-4a5cea0923bf tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:42.210626 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-89eea33d-7e3c-4d6b-9dfa-4a5cea0923bf tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:42.211145 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-89eea33d-7e3c-4d6b-9dfa-4a5cea0923bf tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:42.212015 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-89eea33d-7e3c-4d6b-9dfa-4a5cea0923bf tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:42.212530 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-89eea33d-7e3c-4d6b-9dfa-4a5cea0923bf tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:42.350016 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-89eea33d-7e3c-4d6b-9dfa-4a5cea0923bf tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 28669 microversion: 2.1 time: 0.154677 Apr 20 18:38:42.350777 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 449/889] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:42 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 28669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:42.405939 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-848215c6-1bca-42e4-a893-33b293e8fe57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:42.407629 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-848215c6-1bca-42e4-a893-33b293e8fe57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:42.416648 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-848215c6-1bca-42e4-a893-33b293e8fe57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:42.417167 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-848215c6-1bca-42e4-a893-33b293e8fe57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:42.418066 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-848215c6-1bca-42e4-a893-33b293e8fe57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:42.418568 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-848215c6-1bca-42e4-a893-33b293e8fe57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:42.568398 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-848215c6-1bca-42e4-a893-33b293e8fe57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 26790 microversion: 2.20 time: 0.166979 Apr 20 18:38:42.569141 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 441/890] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:42 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 26790 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:38:43.364382 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6927493f-4219-4cf4-ba57-3fb64ffec89b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:43.365607 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6927493f-4219-4cf4-ba57-3fb64ffec89b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:43.376203 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6927493f-4219-4cf4-ba57-3fb64ffec89b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:43.376760 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6927493f-4219-4cf4-ba57-3fb64ffec89b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:43.377668 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6927493f-4219-4cf4-ba57-3fb64ffec89b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:43.378178 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6927493f-4219-4cf4-ba57-3fb64ffec89b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:43.529469 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6927493f-4219-4cf4-ba57-3fb64ffec89b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 29533 microversion: 2.1 time: 0.170113 Apr 20 18:38:43.530216 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 450/891] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:43 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 29533 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:43.582693 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e9e570e8-fc8b-443b-a5f8-729b3c302c21 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:43.583847 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e9e570e8-fc8b-443b-a5f8-729b3c302c21 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:43.596237 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e9e570e8-fc8b-443b-a5f8-729b3c302c21 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:43.596758 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e9e570e8-fc8b-443b-a5f8-729b3c302c21 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:43.597656 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e9e570e8-fc8b-443b-a5f8-729b3c302c21 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:43.598168 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e9e570e8-fc8b-443b-a5f8-729b3c302c21 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:43.740714 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e9e570e8-fc8b-443b-a5f8-729b3c302c21 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 27426 microversion: 2.20 time: 0.162505 Apr 20 18:38:43.741483 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 442/892] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:43 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 27426 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:38:44.543500 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-013be4a8-c943-47d5-b5ca-6e69daa356dc tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:44.544645 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-013be4a8-c943-47d5-b5ca-6e69daa356dc tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:44.553618 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-013be4a8-c943-47d5-b5ca-6e69daa356dc tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:44.554126 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-013be4a8-c943-47d5-b5ca-6e69daa356dc tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:44.554976 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-013be4a8-c943-47d5-b5ca-6e69daa356dc tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:44.555476 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-013be4a8-c943-47d5-b5ca-6e69daa356dc tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:44.710833 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-013be4a8-c943-47d5-b5ca-6e69daa356dc tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 31103 microversion: 2.1 time: 0.171495 Apr 20 18:38:44.711755 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 451/893] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:44 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 31103 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:44.753955 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c79c84e3-27a8-40cd-8ef9-7c86f6cf3ca7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:44.755207 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c79c84e3-27a8-40cd-8ef9-7c86f6cf3ca7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:44.764155 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c79c84e3-27a8-40cd-8ef9-7c86f6cf3ca7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:44.764680 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c79c84e3-27a8-40cd-8ef9-7c86f6cf3ca7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:44.766124 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c79c84e3-27a8-40cd-8ef9-7c86f6cf3ca7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:44.766624 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c79c84e3-27a8-40cd-8ef9-7c86f6cf3ca7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:44.919669 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c79c84e3-27a8-40cd-8ef9-7c86f6cf3ca7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 27791 microversion: 2.20 time: 0.170208 Apr 20 18:38:44.920413 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 443/894] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:44 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 27791 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:38:45.724925 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-77301ec9-d1ff-4bbb-9025-4025059e1823 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:45.726123 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-77301ec9-d1ff-4bbb-9025-4025059e1823 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:45.736472 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-77301ec9-d1ff-4bbb-9025-4025059e1823 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:45.736982 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-77301ec9-d1ff-4bbb-9025-4025059e1823 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:45.737869 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-77301ec9-d1ff-4bbb-9025-4025059e1823 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:45.738367 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-77301ec9-d1ff-4bbb-9025-4025059e1823 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:45.907174 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-77301ec9-d1ff-4bbb-9025-4025059e1823 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 32296 microversion: 2.1 time: 0.185640 Apr 20 18:38:45.908196 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 452/895] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:45 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 32296 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:45.933409 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8fe5b5fc-691c-44de-a270-414eb118afc9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:45.934603 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8fe5b5fc-691c-44de-a270-414eb118afc9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:45.943733 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8fe5b5fc-691c-44de-a270-414eb118afc9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:45.944260 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8fe5b5fc-691c-44de-a270-414eb118afc9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:45.945133 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8fe5b5fc-691c-44de-a270-414eb118afc9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:45.945663 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8fe5b5fc-691c-44de-a270-414eb118afc9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:46.107176 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8fe5b5fc-691c-44de-a270-414eb118afc9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 28214 microversion: 2.20 time: 0.178147 Apr 20 18:38:46.107916 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 444/896] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:45 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 28214 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:38:46.920661 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-da817de4-3d95-41d9-8593-2f32d4cebf2c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:46.922000 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-da817de4-3d95-41d9-8593-2f32d4cebf2c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:46.931161 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-da817de4-3d95-41d9-8593-2f32d4cebf2c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:46.931675 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-da817de4-3d95-41d9-8593-2f32d4cebf2c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:46.932544 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-da817de4-3d95-41d9-8593-2f32d4cebf2c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:46.933048 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-da817de4-3d95-41d9-8593-2f32d4cebf2c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:47.072162 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-da817de4-3d95-41d9-8593-2f32d4cebf2c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 33119 microversion: 2.1 time: 0.155842 Apr 20 18:38:47.073195 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 453/897] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:46 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 33119 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:47.121139 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f97386ea-5722-47fd-8a45-bccf79e7be2f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:47.122316 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f97386ea-5722-47fd-8a45-bccf79e7be2f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:47.131973 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f97386ea-5722-47fd-8a45-bccf79e7be2f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:47.132485 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f97386ea-5722-47fd-8a45-bccf79e7be2f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:47.133575 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f97386ea-5722-47fd-8a45-bccf79e7be2f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:47.134204 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f97386ea-5722-47fd-8a45-bccf79e7be2f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:47.271755 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f97386ea-5722-47fd-8a45-bccf79e7be2f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 28214 microversion: 2.20 time: 0.155084 Apr 20 18:38:47.272484 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 445/898] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:47 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 28214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:38:48.085688 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a9ddd6a2-73d4-4c14-82c9-4dfe0c0944c8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:48.086845 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a9ddd6a2-73d4-4c14-82c9-4dfe0c0944c8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:48.096303 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a9ddd6a2-73d4-4c14-82c9-4dfe0c0944c8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:48.096836 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a9ddd6a2-73d4-4c14-82c9-4dfe0c0944c8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:48.097723 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a9ddd6a2-73d4-4c14-82c9-4dfe0c0944c8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:48.098226 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a9ddd6a2-73d4-4c14-82c9-4dfe0c0944c8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:48.251183 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a9ddd6a2-73d4-4c14-82c9-4dfe0c0944c8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 33856 microversion: 2.1 time: 0.169866 Apr 20 18:38:48.251914 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 454/899] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:48 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 33856 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:48.285721 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1175937d-fd50-42e5-a558-3b9243bbe5f2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:48.286896 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1175937d-fd50-42e5-a558-3b9243bbe5f2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:48.295804 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1175937d-fd50-42e5-a558-3b9243bbe5f2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:48.296453 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1175937d-fd50-42e5-a558-3b9243bbe5f2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:48.297332 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1175937d-fd50-42e5-a558-3b9243bbe5f2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:48.297865 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1175937d-fd50-42e5-a558-3b9243bbe5f2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:48.445861 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1175937d-fd50-42e5-a558-3b9243bbe5f2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 28504 microversion: 2.20 time: 0.164786 Apr 20 18:38:48.446596 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 446/900] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:48 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 28504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:38:49.264572 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7d649bbf-f081-4569-b27a-8c6adfae4da4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:49.266528 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7d649bbf-f081-4569-b27a-8c6adfae4da4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:49.275146 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7d649bbf-f081-4569-b27a-8c6adfae4da4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:49.275665 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7d649bbf-f081-4569-b27a-8c6adfae4da4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:49.276510 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7d649bbf-f081-4569-b27a-8c6adfae4da4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:49.277010 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7d649bbf-f081-4569-b27a-8c6adfae4da4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:49.434462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7d649bbf-f081-4569-b27a-8c6adfae4da4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 35090 microversion: 2.1 time: 0.174169 Apr 20 18:38:49.435193 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 455/901] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:49 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 35090 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:49.459800 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-bf9c728d-47f3-431f-8464-874214b1fdca tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:49.460945 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-bf9c728d-47f3-431f-8464-874214b1fdca tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:49.471390 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bf9c728d-47f3-431f-8464-874214b1fdca tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:49.471906 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bf9c728d-47f3-431f-8464-874214b1fdca tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:49.472769 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bf9c728d-47f3-431f-8464-874214b1fdca tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:49.473291 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bf9c728d-47f3-431f-8464-874214b1fdca tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:49.630650 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-bf9c728d-47f3-431f-8464-874214b1fdca tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 28672 microversion: 2.20 time: 0.175102 Apr 20 18:38:49.631312 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 447/902] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:49 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 28672 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:38:50.448055 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-53fad0d1-d2ac-406c-9b1a-887bda20c91c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:50.449219 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-53fad0d1-d2ac-406c-9b1a-887bda20c91c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:50.458998 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-53fad0d1-d2ac-406c-9b1a-887bda20c91c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:50.459502 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-53fad0d1-d2ac-406c-9b1a-887bda20c91c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:50.460369 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-53fad0d1-d2ac-406c-9b1a-887bda20c91c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:50.460862 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-53fad0d1-d2ac-406c-9b1a-887bda20c91c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:50.604055 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-53fad0d1-d2ac-406c-9b1a-887bda20c91c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 36066 microversion: 2.1 time: 0.160388 Apr 20 18:38:50.604860 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 456/903] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:50 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 36066 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:50.644547 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7f2dfbb2-6ea3-4821-aec6-3245542526b0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:50.645767 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7f2dfbb2-6ea3-4821-aec6-3245542526b0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:50.654440 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7f2dfbb2-6ea3-4821-aec6-3245542526b0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:50.655004 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7f2dfbb2-6ea3-4821-aec6-3245542526b0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:50.656450 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7f2dfbb2-6ea3-4821-aec6-3245542526b0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:50.657047 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7f2dfbb2-6ea3-4821-aec6-3245542526b0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:50.801537 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7f2dfbb2-6ea3-4821-aec6-3245542526b0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 28672 microversion: 2.20 time: 0.161880 Apr 20 18:38:50.802274 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 448/904] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:50 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 28672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:38:51.617696 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3bb5f171-d55a-4816-990f-83c6965e7037 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:51.618852 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3bb5f171-d55a-4816-990f-83c6965e7037 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:51.628861 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3bb5f171-d55a-4816-990f-83c6965e7037 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:51.629747 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3bb5f171-d55a-4816-990f-83c6965e7037 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:51.630249 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3bb5f171-d55a-4816-990f-83c6965e7037 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:51.630742 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3bb5f171-d55a-4816-990f-83c6965e7037 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:51.785732 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3bb5f171-d55a-4816-990f-83c6965e7037 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 37145 microversion: 2.1 time: 0.172317 Apr 20 18:38:51.786452 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 457/905] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:51 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 37145 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:51.815017 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b354d664-ceae-4cee-8ecb-d0658d7f5260 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:51.816203 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b354d664-ceae-4cee-8ecb-d0658d7f5260 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:51.824839 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b354d664-ceae-4cee-8ecb-d0658d7f5260 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:51.825346 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b354d664-ceae-4cee-8ecb-d0658d7f5260 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:51.826205 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b354d664-ceae-4cee-8ecb-d0658d7f5260 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:51.826692 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b354d664-ceae-4cee-8ecb-d0658d7f5260 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:51.970411 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b354d664-ceae-4cee-8ecb-d0658d7f5260 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 28672 microversion: 2.20 time: 0.159862 Apr 20 18:38:51.971385 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 449/906] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:51 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 28672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:38:52.799981 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4557e74d-6ab3-443e-8961-38278397fa9b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:52.801147 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4557e74d-6ab3-443e-8961-38278397fa9b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:52.810411 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4557e74d-6ab3-443e-8961-38278397fa9b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:52.810927 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4557e74d-6ab3-443e-8961-38278397fa9b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:52.811785 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4557e74d-6ab3-443e-8961-38278397fa9b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:52.812935 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4557e74d-6ab3-443e-8961-38278397fa9b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:52.953626 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4557e74d-6ab3-443e-8961-38278397fa9b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 38188 microversion: 2.1 time: 0.158622 Apr 20 18:38:52.954361 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 458/907] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:52 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 38188 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:52.984893 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-dcd14d6a-88de-4feb-b7f4-5079fe4f4c75 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:52.986336 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-dcd14d6a-88de-4feb-b7f4-5079fe4f4c75 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:52.995479 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dcd14d6a-88de-4feb-b7f4-5079fe4f4c75 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:52.995997 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dcd14d6a-88de-4feb-b7f4-5079fe4f4c75 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:52.996868 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dcd14d6a-88de-4feb-b7f4-5079fe4f4c75 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:52.997373 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dcd14d6a-88de-4feb-b7f4-5079fe4f4c75 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:53.130050 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-dcd14d6a-88de-4feb-b7f4-5079fe4f4c75 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 28672 microversion: 2.20 time: 0.150157 Apr 20 18:38:53.130934 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 450/908] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:52 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 28672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:38:53.967430 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1e410697-271a-4554-bf59-69317a1d5162 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:53.969297 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1e410697-271a-4554-bf59-69317a1d5162 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:53.978215 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1e410697-271a-4554-bf59-69317a1d5162 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:53.978637 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1e410697-271a-4554-bf59-69317a1d5162 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:53.979501 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1e410697-271a-4554-bf59-69317a1d5162 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:53.979995 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1e410697-271a-4554-bf59-69317a1d5162 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:54.123605 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1e410697-271a-4554-bf59-69317a1d5162 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 38188 microversion: 2.1 time: 0.160429 Apr 20 18:38:54.124346 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 459/909] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:53 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 38188 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:54.144524 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c2e01e9e-0b95-43f4-a22a-9e49525d0c57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:54.145724 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c2e01e9e-0b95-43f4-a22a-9e49525d0c57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:54.154728 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c2e01e9e-0b95-43f4-a22a-9e49525d0c57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:54.155248 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c2e01e9e-0b95-43f4-a22a-9e49525d0c57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:54.156223 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c2e01e9e-0b95-43f4-a22a-9e49525d0c57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:54.156722 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c2e01e9e-0b95-43f4-a22a-9e49525d0c57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:54.305841 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c2e01e9e-0b95-43f4-a22a-9e49525d0c57 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 29205 microversion: 2.20 time: 0.166465 Apr 20 18:38:54.306591 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 451/910] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:54 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 29205 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:38:55.137019 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-596b1559-ba30-498a-98a4-2bfb230b1f77 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:55.138195 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-596b1559-ba30-498a-98a4-2bfb230b1f77 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:55.148047 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-596b1559-ba30-498a-98a4-2bfb230b1f77 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:55.148559 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-596b1559-ba30-498a-98a4-2bfb230b1f77 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:55.149448 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-596b1559-ba30-498a-98a4-2bfb230b1f77 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:55.149970 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-596b1559-ba30-498a-98a4-2bfb230b1f77 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:55.300231 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-596b1559-ba30-498a-98a4-2bfb230b1f77 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 38188 microversion: 2.1 time: 0.167502 Apr 20 18:38:55.301033 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 460/911] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:55 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 38188 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:55.319646 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-33aed12c-06b8-4da6-835a-8bf47c1d2bbd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:55.320813 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-33aed12c-06b8-4da6-835a-8bf47c1d2bbd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:55.331150 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-33aed12c-06b8-4da6-835a-8bf47c1d2bbd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:55.331653 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-33aed12c-06b8-4da6-835a-8bf47c1d2bbd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:55.332518 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-33aed12c-06b8-4da6-835a-8bf47c1d2bbd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:55.333014 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-33aed12c-06b8-4da6-835a-8bf47c1d2bbd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:55.479446 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-33aed12c-06b8-4da6-835a-8bf47c1d2bbd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 30908 microversion: 2.20 time: 0.164268 Apr 20 18:38:55.480464 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 452/912] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:55 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 30908 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:38:56.314546 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-87233b5e-1d11-417d-b540-334c0088a709 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:56.315722 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-87233b5e-1d11-417d-b540-334c0088a709 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:56.324793 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-87233b5e-1d11-417d-b540-334c0088a709 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:56.325314 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-87233b5e-1d11-417d-b540-334c0088a709 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:56.326235 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-87233b5e-1d11-417d-b540-334c0088a709 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:56.326739 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-87233b5e-1d11-417d-b540-334c0088a709 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:56.470756 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-87233b5e-1d11-417d-b540-334c0088a709 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action" status: 200 len: 38315 microversion: 2.1 time: 0.160816 Apr 20 18:38:56.471487 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 461/913] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:38:56 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/action => generated 38315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:38:56.483691 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5c7fe6a1-cd49-427b-8476-f752ec934cd4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:38:56.487451 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5c7fe6a1-cd49-427b-8476-f752ec934cd4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:56.493747 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6181fd5b-5691-4e0d-90fd-7fd62609956d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:56.494909 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6181fd5b-5691-4e0d-90fd-7fd62609956d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:56.496241 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5c7fe6a1-cd49-427b-8476-f752ec934cd4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:56.496883 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5c7fe6a1-cd49-427b-8476-f752ec934cd4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:56.497921 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5c7fe6a1-cd49-427b-8476-f752ec934cd4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:56.498534 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5c7fe6a1-cd49-427b-8476-f752ec934cd4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:56.504184 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6181fd5b-5691-4e0d-90fd-7fd62609956d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:56.504690 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6181fd5b-5691-4e0d-90fd-7fd62609956d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:56.505587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6181fd5b-5691-4e0d-90fd-7fd62609956d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:56.506085 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6181fd5b-5691-4e0d-90fd-7fd62609956d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:56.568675 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5c7fe6a1-cd49-427b-8476-f752ec934cd4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/ips" status: 200 len: 146 microversion: 2.1 time: 0.089838 Apr 20 18:38:56.575223 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 453/914] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Apr 20 18:38:56 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/ips => generated 146 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:38:56.657598 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6181fd5b-5691-4e0d-90fd-7fd62609956d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 32728 microversion: 2.20 time: 0.168393 Apr 20 18:38:56.662604 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 462/915] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:56 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 32728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:38:57.670273 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-55f47f42-fddf-48be-8738-d045d31127b5 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:57.672037 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-55f47f42-fddf-48be-8738-d045d31127b5 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:57.681115 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-55f47f42-fddf-48be-8738-d045d31127b5 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:57.681592 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-55f47f42-fddf-48be-8738-d045d31127b5 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:57.682459 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-55f47f42-fddf-48be-8738-d045d31127b5 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:57.682964 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-55f47f42-fddf-48be-8738-d045d31127b5 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:57.875263 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-55f47f42-fddf-48be-8738-d045d31127b5 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 33444 microversion: 2.20 time: 0.209043 Apr 20 18:38:57.875994 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 454/916] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:57 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 33444 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:38:58.173981 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4e2c592b-53b0-4587-a361-9e7dffd0cf29 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca383b72-848b-452e-8150-f38f10f983bb"}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:58.175300 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4e2c592b-53b0-4587-a361-9e7dffd0cf29 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:58.184298 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4e2c592b-53b0-4587-a361-9e7dffd0cf29 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:58.184815 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4e2c592b-53b0-4587-a361-9e7dffd0cf29 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:58.185709 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4e2c592b-53b0-4587-a361-9e7dffd0cf29 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:58.186214 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4e2c592b-53b0-4587-a361-9e7dffd0cf29 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:58.601086 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4e2c592b-53b0-4587-a361-9e7dffd0cf29 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.431893 Apr 20 18:38:58.601814 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 463/917] 10.222.0.25 () {60 vars in 1313 bytes} [Tue Apr 20 18:38:58 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/os-volume_attachments => generated 194 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:38:58.889049 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ae0dee9f-7747-4216-8462-01da78334d71 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:38:58.890820 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ae0dee9f-7747-4216-8462-01da78334d71 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:38:58.900614 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ae0dee9f-7747-4216-8462-01da78334d71 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:58.901125 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ae0dee9f-7747-4216-8462-01da78334d71 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:58.902020 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ae0dee9f-7747-4216-8462-01da78334d71 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:38:58.902514 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ae0dee9f-7747-4216-8462-01da78334d71 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:38:59.049343 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ae0dee9f-7747-4216-8462-01da78334d71 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 34324 microversion: 2.20 time: 0.164742 Apr 20 18:38:59.050120 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 455/918] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:38:58 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 34324 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:39:00.066305 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6a41e581-ce1c-4ec1-8828-a155a09fab58 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:39:00.067562 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6a41e581-ce1c-4ec1-8828-a155a09fab58 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:00.076644 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6a41e581-ce1c-4ec1-8828-a155a09fab58 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:00.077173 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6a41e581-ce1c-4ec1-8828-a155a09fab58 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:00.078707 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6a41e581-ce1c-4ec1-8828-a155a09fab58 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:00.079210 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6a41e581-ce1c-4ec1-8828-a155a09fab58 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:00.220892 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6a41e581-ce1c-4ec1-8828-a155a09fab58 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 35363 microversion: 2.20 time: 0.159997 Apr 20 18:39:00.221653 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 464/919] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:39:00 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 35363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:39:01.235156 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d292e5b2-acb3-42df-9ffa-af36f8aad720 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:39:01.236252 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d292e5b2-acb3-42df-9ffa-af36f8aad720 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:01.245180 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d292e5b2-acb3-42df-9ffa-af36f8aad720 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:01.245724 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d292e5b2-acb3-42df-9ffa-af36f8aad720 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:01.246587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d292e5b2-acb3-42df-9ffa-af36f8aad720 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:01.247084 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d292e5b2-acb3-42df-9ffa-af36f8aad720 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:01.385055 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d292e5b2-acb3-42df-9ffa-af36f8aad720 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 36636 microversion: 2.20 time: 0.154811 Apr 20 18:39:01.386602 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 456/920] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:39:01 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 36636 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:39:02.399490 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9c58a6af-b95d-46f8-8800-be6e90c145b4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:39:02.400772 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9c58a6af-b95d-46f8-8800-be6e90c145b4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:02.409972 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9c58a6af-b95d-46f8-8800-be6e90c145b4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:02.410578 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9c58a6af-b95d-46f8-8800-be6e90c145b4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:02.411533 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9c58a6af-b95d-46f8-8800-be6e90c145b4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:02.412006 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9c58a6af-b95d-46f8-8800-be6e90c145b4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:02.550564 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9c58a6af-b95d-46f8-8800-be6e90c145b4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 37831 microversion: 2.20 time: 0.155627 Apr 20 18:39:02.551313 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 465/921] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:39:02 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 37831 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:39:03.564969 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c3f68f4c-e763-4817-be56-ffcc802dbd1b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:39:03.566226 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c3f68f4c-e763-4817-be56-ffcc802dbd1b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:03.575089 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c3f68f4c-e763-4817-be56-ffcc802dbd1b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:03.575606 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c3f68f4c-e763-4817-be56-ffcc802dbd1b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:03.576462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c3f68f4c-e763-4817-be56-ffcc802dbd1b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:03.577725 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c3f68f4c-e763-4817-be56-ffcc802dbd1b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:03.735480 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c3f68f4c-e763-4817-be56-ffcc802dbd1b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 38223 microversion: 2.20 time: 0.175503 Apr 20 18:39:03.736146 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 457/922] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:39:03 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 38223 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:39:04.749850 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d03d1565-1a7f-456f-b63d-33477f3186b9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:39:04.751268 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d03d1565-1a7f-456f-b63d-33477f3186b9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:04.763732 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d03d1565-1a7f-456f-b63d-33477f3186b9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:04.764228 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d03d1565-1a7f-456f-b63d-33477f3186b9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:04.766418 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d03d1565-1a7f-456f-b63d-33477f3186b9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:04.766939 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d03d1565-1a7f-456f-b63d-33477f3186b9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:04.931727 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d03d1565-1a7f-456f-b63d-33477f3186b9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 38223 microversion: 2.20 time: 0.187129 Apr 20 18:39:04.932964 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 466/923] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:39:04 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 38223 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:39:05.945895 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a6a1bb1f-87d7-442e-b875-15b1b6068ac1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:39:05.946992 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a6a1bb1f-87d7-442e-b875-15b1b6068ac1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:05.957417 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a6a1bb1f-87d7-442e-b875-15b1b6068ac1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:05.957939 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a6a1bb1f-87d7-442e-b875-15b1b6068ac1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:05.958816 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a6a1bb1f-87d7-442e-b875-15b1b6068ac1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:05.959321 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a6a1bb1f-87d7-442e-b875-15b1b6068ac1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:06.102713 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a6a1bb1f-87d7-442e-b875-15b1b6068ac1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 38234 microversion: 2.20 time: 0.161335 Apr 20 18:39:06.103471 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 458/924] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:39:05 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 38234 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:39:06.532825 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-54534751-a9cc-40db-89bc-87215ae8e1b1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:06.534049 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-54534751-a9cc-40db-89bc-87215ae8e1b1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:06.545079 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-54534751-a9cc-40db-89bc-87215ae8e1b1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:06.545625 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-54534751-a9cc-40db-89bc-87215ae8e1b1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:06.546621 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-54534751-a9cc-40db-89bc-87215ae8e1b1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:06.547121 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-54534751-a9cc-40db-89bc-87215ae8e1b1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:06.620622 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-54534751-a9cc-40db-89bc-87215ae8e1b1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092372 Apr 20 18:39:06.621271 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 467/925] 10.222.0.25 () {58 vars in 1292 bytes} [Tue Apr 20 18:39:06 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:39:06.632911 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6d74bea3-ecc5-46ff-bb03-d3bd5b97653f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:06.633595 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6d74bea3-ecc5-46ff-bb03-d3bd5b97653f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:06.643329 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6d74bea3-ecc5-46ff-bb03-d3bd5b97653f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:06.643838 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6d74bea3-ecc5-46ff-bb03-d3bd5b97653f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:06.644710 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6d74bea3-ecc5-46ff-bb03-d3bd5b97653f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:06.645210 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6d74bea3-ecc5-46ff-bb03-d3bd5b97653f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:06.716941 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6d74bea3-ecc5-46ff-bb03-d3bd5b97653f tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/os-volume_attachments/ca383b72-848b-452e-8150-f38f10f983bb" status: 200 len: 194 microversion: 2.1 time: 0.088537 Apr 20 18:39:06.717575 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 459/926] 10.222.0.25 () {58 vars in 1403 bytes} [Tue Apr 20 18:39:06 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/os-volume_attachments/ca383b72-848b-452e-8150-f38f10f983bb => generated 194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:39:07.117722 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9d0fc8a8-c9a6-4caa-83f2-6a9187287c1c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:39:07.118937 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9d0fc8a8-c9a6-4caa-83f2-6a9187287c1c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:07.128068 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9d0fc8a8-c9a6-4caa-83f2-6a9187287c1c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:07.128628 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9d0fc8a8-c9a6-4caa-83f2-6a9187287c1c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:07.129518 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9d0fc8a8-c9a6-4caa-83f2-6a9187287c1c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:07.130011 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9d0fc8a8-c9a6-4caa-83f2-6a9187287c1c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:07.268732 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9d0fc8a8-c9a6-4caa-83f2-6a9187287c1c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 200 len: 38364 microversion: 2.20 time: 0.155802 Apr 20 18:39:07.269508 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 468/927] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:39:07 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 38364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:39:07.280126 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2cde1fcc-7258-4aa6-a7f0-e4c11c6a6e95 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:07.281748 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2cde1fcc-7258-4aa6-a7f0-e4c11c6a6e95 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:07.289729 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2cde1fcc-7258-4aa6-a7f0-e4c11c6a6e95 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:07.290241 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2cde1fcc-7258-4aa6-a7f0-e4c11c6a6e95 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:07.291091 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2cde1fcc-7258-4aa6-a7f0-e4c11c6a6e95 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:07.291587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2cde1fcc-7258-4aa6-a7f0-e4c11c6a6e95 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:07.354481 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2cde1fcc-7258-4aa6-a7f0-e4c11c6a6e95 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/ips" status: 200 len: 153 microversion: 2.20 time: 0.078435 Apr 20 18:39:07.355171 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 460/928] 10.222.0.25 () {60 vars in 1279 bytes} [Tue Apr 20 18:39:07 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/ips => generated 153 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:39:08.235228 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f6289794-10f4-4d67-9b80-3b177fa19a80 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0be84830-0280-4dfe-ac2c-7242b6a8eedc"}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:39:08.236517 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f6289794-10f4-4d67-9b80-3b177fa19a80 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:08.245167 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f6289794-10f4-4d67-9b80-3b177fa19a80 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:08.245709 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f6289794-10f4-4d67-9b80-3b177fa19a80 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:08.246556 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f6289794-10f4-4d67-9b80-3b177fa19a80 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:08.247047 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f6289794-10f4-4d67-9b80-3b177fa19a80 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:08.635436 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f6289794-10f4-4d67-9b80-3b177fa19a80 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.404607 Apr 20 18:39:08.636114 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 469/929] 10.222.0.25 () {60 vars in 1313 bytes} [Tue Apr 20 18:39:08 2021] POST /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/os-volume_attachments => generated 194 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:39:09.102522 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2344644f-fd06-4555-a8c7-7aa723f99678 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:39:09.103527 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2344644f-fd06-4555-a8c7-7aa723f99678 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:09.112170 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2344644f-fd06-4555-a8c7-7aa723f99678 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:09.112699 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2344644f-fd06-4555-a8c7-7aa723f99678 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:09.113579 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2344644f-fd06-4555-a8c7-7aa723f99678 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:09.114085 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2344644f-fd06-4555-a8c7-7aa723f99678 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:09.271701 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2344644f-fd06-4555-a8c7-7aa723f99678 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "POST /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59/action" status: 202 len: 0 microversion: 2.1 time: 0.173469 Apr 20 18:39:09.272741 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 461/930] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:39:09 2021] POST /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:39:09.282286 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-abc5adb2-75eb-4846-abda-9ebcf00ca6ca tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:09.283072 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-abc5adb2-75eb-4846-abda-9ebcf00ca6ca tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:09.302105 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-abc5adb2-75eb-4846-abda-9ebcf00ca6ca tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:09.302606 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-abc5adb2-75eb-4846-abda-9ebcf00ca6ca tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:09.303455 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-abc5adb2-75eb-4846-abda-9ebcf00ca6ca tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:09.303943 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-abc5adb2-75eb-4846-abda-9ebcf00ca6ca tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:09.742766 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-281be03f-c4f5-48f8-919a-43208c94e424 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:39:09.743719 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-281be03f-c4f5-48f8-919a-43208c94e424 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:09.754065 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-281be03f-c4f5-48f8-919a-43208c94e424 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:09.755035 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-281be03f-c4f5-48f8-919a-43208c94e424 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:09.757065 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-281be03f-c4f5-48f8-919a-43208c94e424 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:09.757833 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-281be03f-c4f5-48f8-919a-43208c94e424 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:09.786567 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-abc5adb2-75eb-4846-abda-9ebcf00ca6ca tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:09.798925 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-abc5adb2-75eb-4846-abda-9ebcf00ca6ca tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1750 microversion: 2.1 time: 0.521394 Apr 20 18:39:09.799895 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 470/931] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:09 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1750 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:09.823421 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-281be03f-c4f5-48f8-919a-43208c94e424 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lazy-loading 'flavor' on Instance uuid bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:39:10.194360 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-281be03f-c4f5-48f8-919a-43208c94e424 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 202 len: 0 microversion: 2.20 time: 0.456177 Apr 20 18:39:10.202999 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 462/932] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:39:09 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:39:10.209092 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-da17e1fa-431c-4659-a465-a2be5bcc2cbc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:10.210497 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-da17e1fa-431c-4659-a465-a2be5bcc2cbc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:10.219243 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-da17e1fa-431c-4659-a465-a2be5bcc2cbc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:10.219941 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-da17e1fa-431c-4659-a465-a2be5bcc2cbc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:10.220908 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-da17e1fa-431c-4659-a465-a2be5bcc2cbc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:10.221544 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-da17e1fa-431c-4659-a465-a2be5bcc2cbc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:10.475760 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-da17e1fa-431c-4659-a465-a2be5bcc2cbc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:10.497054 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-da17e1fa-431c-4659-a465-a2be5bcc2cbc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:10.501204 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-da17e1fa-431c-4659-a465-a2be5bcc2cbc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:10.504672 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-da17e1fa-431c-4659-a465-a2be5bcc2cbc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1724 microversion: 2.20 time: 0.299369 Apr 20 18:39:10.505894 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 471/933] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:10 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:10.819089 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-67710e22-b94c-4c06-81a0-ac7eed00f1c5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:10.819880 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-67710e22-b94c-4c06-81a0-ac7eed00f1c5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:10.829523 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-67710e22-b94c-4c06-81a0-ac7eed00f1c5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:10.830044 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-67710e22-b94c-4c06-81a0-ac7eed00f1c5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:10.830889 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-67710e22-b94c-4c06-81a0-ac7eed00f1c5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:10.831391 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-67710e22-b94c-4c06-81a0-ac7eed00f1c5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:11.047046 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-67710e22-b94c-4c06-81a0-ac7eed00f1c5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:11.056667 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-67710e22-b94c-4c06-81a0-ac7eed00f1c5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1755 microversion: 2.1 time: 0.242101 Apr 20 18:39:11.057314 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 463/934] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:10 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1755 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:11.526829 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8f400930-f255-481e-b1db-9caf3bdc0cfc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:11.527500 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8f400930-f255-481e-b1db-9caf3bdc0cfc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:11.536251 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8f400930-f255-481e-b1db-9caf3bdc0cfc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:11.536766 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8f400930-f255-481e-b1db-9caf3bdc0cfc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:11.537629 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8f400930-f255-481e-b1db-9caf3bdc0cfc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:11.538124 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8f400930-f255-481e-b1db-9caf3bdc0cfc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:11.753698 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8f400930-f255-481e-b1db-9caf3bdc0cfc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:11.763400 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8f400930-f255-481e-b1db-9caf3bdc0cfc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:11.765307 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8f400930-f255-481e-b1db-9caf3bdc0cfc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:11.766595 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8f400930-f255-481e-b1db-9caf3bdc0cfc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1724 microversion: 2.20 time: 0.244362 Apr 20 18:39:11.767239 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 472/935] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:11 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:12.127794 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-99285fcd-c460-44de-a1fe-b578cde34606 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:12.128477 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-99285fcd-c460-44de-a1fe-b578cde34606 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:12.137126 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-99285fcd-c460-44de-a1fe-b578cde34606 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:12.137676 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-99285fcd-c460-44de-a1fe-b578cde34606 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:12.138531 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-99285fcd-c460-44de-a1fe-b578cde34606 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:12.139025 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-99285fcd-c460-44de-a1fe-b578cde34606 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:12.364149 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-99285fcd-c460-44de-a1fe-b578cde34606 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:12.373866 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-99285fcd-c460-44de-a1fe-b578cde34606 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1755 microversion: 2.1 time: 0.250821 Apr 20 18:39:12.374560 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 464/936] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:12 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1755 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:12.786766 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-afd2f81a-f511-441b-a244-3ea0a0e197b8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:12.787442 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-afd2f81a-f511-441b-a244-3ea0a0e197b8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:12.795475 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-afd2f81a-f511-441b-a244-3ea0a0e197b8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:12.796029 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-afd2f81a-f511-441b-a244-3ea0a0e197b8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:12.796902 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-afd2f81a-f511-441b-a244-3ea0a0e197b8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:12.797423 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-afd2f81a-f511-441b-a244-3ea0a0e197b8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:13.161456 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-afd2f81a-f511-441b-a244-3ea0a0e197b8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:13.171102 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-afd2f81a-f511-441b-a244-3ea0a0e197b8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:13.172938 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-afd2f81a-f511-441b-a244-3ea0a0e197b8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:13.174206 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-afd2f81a-f511-441b-a244-3ea0a0e197b8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1724 microversion: 2.20 time: 0.391577 Apr 20 18:39:13.174843 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 473/937] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:12 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1724 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:13.393922 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d495223d-fb09-4bfb-9ec8-2440f145c5c8 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:13.394526 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d495223d-fb09-4bfb-9ec8-2440f145c5c8 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:13.402582 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d495223d-fb09-4bfb-9ec8-2440f145c5c8 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:13.403096 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d495223d-fb09-4bfb-9ec8-2440f145c5c8 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:13.403993 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d495223d-fb09-4bfb-9ec8-2440f145c5c8 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:13.404490 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d495223d-fb09-4bfb-9ec8-2440f145c5c8 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:13.632753 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d495223d-fb09-4bfb-9ec8-2440f145c5c8 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:13.643136 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d495223d-fb09-4bfb-9ec8-2440f145c5c8 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1755 microversion: 2.1 time: 0.254722 Apr 20 18:39:13.643779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 465/938] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:13 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1755 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:14.194079 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b3a8cca8-0adb-4c23-8c3f-2ecb27156f40 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:14.194743 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b3a8cca8-0adb-4c23-8c3f-2ecb27156f40 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:14.202779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b3a8cca8-0adb-4c23-8c3f-2ecb27156f40 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:14.203282 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b3a8cca8-0adb-4c23-8c3f-2ecb27156f40 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:14.204132 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b3a8cca8-0adb-4c23-8c3f-2ecb27156f40 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:14.204621 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b3a8cca8-0adb-4c23-8c3f-2ecb27156f40 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:14.424431 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b3a8cca8-0adb-4c23-8c3f-2ecb27156f40 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:14.434364 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b3a8cca8-0adb-4c23-8c3f-2ecb27156f40 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:14.436048 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b3a8cca8-0adb-4c23-8c3f-2ecb27156f40 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:14.437945 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b3a8cca8-0adb-4c23-8c3f-2ecb27156f40 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1724 microversion: 2.20 time: 0.247874 Apr 20 18:39:14.438566 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 474/939] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:14 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:14.662695 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-166d5344-a433-4682-bb04-838525378266 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:14.663368 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-166d5344-a433-4682-bb04-838525378266 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:14.672232 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-166d5344-a433-4682-bb04-838525378266 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:14.672745 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-166d5344-a433-4682-bb04-838525378266 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:14.673638 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-166d5344-a433-4682-bb04-838525378266 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:14.674138 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-166d5344-a433-4682-bb04-838525378266 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:14.898938 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-166d5344-a433-4682-bb04-838525378266 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:14.909004 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-166d5344-a433-4682-bb04-838525378266 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1755 microversion: 2.1 time: 0.250631 Apr 20 18:39:14.909674 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 466/940] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:14 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1755 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:15.457965 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-267f0367-1a69-4fda-bf54-5d3878e2c944 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:15.458633 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-267f0367-1a69-4fda-bf54-5d3878e2c944 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:15.466481 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-267f0367-1a69-4fda-bf54-5d3878e2c944 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:15.466998 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-267f0367-1a69-4fda-bf54-5d3878e2c944 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:15.467878 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-267f0367-1a69-4fda-bf54-5d3878e2c944 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:15.468440 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-267f0367-1a69-4fda-bf54-5d3878e2c944 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:15.688753 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-267f0367-1a69-4fda-bf54-5d3878e2c944 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:15.698777 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-267f0367-1a69-4fda-bf54-5d3878e2c944 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:15.700477 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-267f0367-1a69-4fda-bf54-5d3878e2c944 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:15.701833 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-267f0367-1a69-4fda-bf54-5d3878e2c944 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1724 microversion: 2.20 time: 0.247858 Apr 20 18:39:15.702506 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 475/941] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:15 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:15.928005 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3d27cf40-ccb5-40fc-8a63-6586dfa4d92d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:15.928606 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3d27cf40-ccb5-40fc-8a63-6586dfa4d92d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:15.936982 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3d27cf40-ccb5-40fc-8a63-6586dfa4d92d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:15.937869 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3d27cf40-ccb5-40fc-8a63-6586dfa4d92d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:15.938382 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3d27cf40-ccb5-40fc-8a63-6586dfa4d92d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:15.939163 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3d27cf40-ccb5-40fc-8a63-6586dfa4d92d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:16.165299 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3d27cf40-ccb5-40fc-8a63-6586dfa4d92d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:16.176084 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3d27cf40-ccb5-40fc-8a63-6586dfa4d92d tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1755 microversion: 2.1 time: 0.252423 Apr 20 18:39:16.176739 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 467/942] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:15 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1755 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:16.514598 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9ebc60e5-91a2-43af-a31d-18ada6dd45d0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:16.515940 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9ebc60e5-91a2-43af-a31d-18ada6dd45d0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:16.524105 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9ebc60e5-91a2-43af-a31d-18ada6dd45d0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:16.524627 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9ebc60e5-91a2-43af-a31d-18ada6dd45d0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:16.525508 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9ebc60e5-91a2-43af-a31d-18ada6dd45d0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:16.526008 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9ebc60e5-91a2-43af-a31d-18ada6dd45d0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:16.598392 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9ebc60e5-91a2-43af-a31d-18ada6dd45d0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.087865 Apr 20 18:39:16.598957 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 476/943] 10.222.0.25 () {58 vars in 1292 bytes} [Tue Apr 20 18:39:16 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/os-volume_attachments => generated 371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:39:16.722522 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-92390958-b21e-4a2a-8fe6-22b92f4c7325 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:16.723199 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-92390958-b21e-4a2a-8fe6-22b92f4c7325 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:16.731495 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-92390958-b21e-4a2a-8fe6-22b92f4c7325 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:16.731996 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-92390958-b21e-4a2a-8fe6-22b92f4c7325 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:16.732824 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-92390958-b21e-4a2a-8fe6-22b92f4c7325 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:16.733908 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-92390958-b21e-4a2a-8fe6-22b92f4c7325 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:16.951293 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-92390958-b21e-4a2a-8fe6-22b92f4c7325 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:16.961517 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-92390958-b21e-4a2a-8fe6-22b92f4c7325 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:16.963206 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-92390958-b21e-4a2a-8fe6-22b92f4c7325 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:16.964442 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-92390958-b21e-4a2a-8fe6-22b92f4c7325 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1724 microversion: 2.20 time: 0.246942 Apr 20 18:39:16.965072 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 468/944] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:16 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:17.195226 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4d2fcde4-38d2-409f-b560-8d546eac0ae5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:17.195842 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4d2fcde4-38d2-409f-b560-8d546eac0ae5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:17.204608 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4d2fcde4-38d2-409f-b560-8d546eac0ae5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:17.205122 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4d2fcde4-38d2-409f-b560-8d546eac0ae5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:17.205999 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4d2fcde4-38d2-409f-b560-8d546eac0ae5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:17.206537 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4d2fcde4-38d2-409f-b560-8d546eac0ae5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:17.423883 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4d2fcde4-38d2-409f-b560-8d546eac0ae5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:17.433496 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4d2fcde4-38d2-409f-b560-8d546eac0ae5 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1755 microversion: 2.1 time: 0.242354 Apr 20 18:39:17.434135 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 477/945] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:17 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1755 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:17.985821 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e25754c0-8f3a-44de-a4c6-39da1609689c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:17.986500 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e25754c0-8f3a-44de-a4c6-39da1609689c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:17.994556 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e25754c0-8f3a-44de-a4c6-39da1609689c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:17.995072 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e25754c0-8f3a-44de-a4c6-39da1609689c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:17.995925 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e25754c0-8f3a-44de-a4c6-39da1609689c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:17.996424 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e25754c0-8f3a-44de-a4c6-39da1609689c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:18.218684 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e25754c0-8f3a-44de-a4c6-39da1609689c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:18.228416 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e25754c0-8f3a-44de-a4c6-39da1609689c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:18.230137 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e25754c0-8f3a-44de-a4c6-39da1609689c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:18.231357 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e25754c0-8f3a-44de-a4c6-39da1609689c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1724 microversion: 2.20 time: 0.249937 Apr 20 18:39:18.232048 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 469/946] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:17 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:18.452680 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3fa612c2-79db-491f-af68-e045fe73f894 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:18.453575 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3fa612c2-79db-491f-af68-e045fe73f894 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:18.461805 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3fa612c2-79db-491f-af68-e045fe73f894 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:18.462309 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3fa612c2-79db-491f-af68-e045fe73f894 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:18.463152 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3fa612c2-79db-491f-af68-e045fe73f894 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:18.463646 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3fa612c2-79db-491f-af68-e045fe73f894 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:18.678069 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3fa612c2-79db-491f-af68-e045fe73f894 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:18.688316 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3fa612c2-79db-491f-af68-e045fe73f894 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1755 microversion: 2.1 time: 0.239892 Apr 20 18:39:18.688960 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 478/947] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:18 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1755 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:19.251532 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-820103fc-084d-43aa-bf66-88dbdac9ca59 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:19.252197 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-820103fc-084d-43aa-bf66-88dbdac9ca59 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:19.260103 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-820103fc-084d-43aa-bf66-88dbdac9ca59 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:19.260601 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-820103fc-084d-43aa-bf66-88dbdac9ca59 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:19.261469 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-820103fc-084d-43aa-bf66-88dbdac9ca59 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:19.261960 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-820103fc-084d-43aa-bf66-88dbdac9ca59 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:19.482596 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-820103fc-084d-43aa-bf66-88dbdac9ca59 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:19.492151 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-820103fc-084d-43aa-bf66-88dbdac9ca59 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:19.493849 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-820103fc-084d-43aa-bf66-88dbdac9ca59 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:19.495072 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-820103fc-084d-43aa-bf66-88dbdac9ca59 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1724 microversion: 2.20 time: 0.248128 Apr 20 18:39:19.495705 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 470/948] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:19 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:19.707814 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-acb8858e-4d5f-4824-bf7d-5e1eda89b356 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:19.708479 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-acb8858e-4d5f-4824-bf7d-5e1eda89b356 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:19.716276 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-acb8858e-4d5f-4824-bf7d-5e1eda89b356 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:19.716784 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-acb8858e-4d5f-4824-bf7d-5e1eda89b356 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:19.717692 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-acb8858e-4d5f-4824-bf7d-5e1eda89b356 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:19.718259 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-acb8858e-4d5f-4824-bf7d-5e1eda89b356 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:19.950986 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-acb8858e-4d5f-4824-bf7d-5e1eda89b356 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:19.961170 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-acb8858e-4d5f-4824-bf7d-5e1eda89b356 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1755 microversion: 2.1 time: 0.257290 Apr 20 18:39:19.961771 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 479/949] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:19 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1755 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:20.515384 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-fab740d5-569a-42a6-a5c8-268ce4a33d58 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:20.516934 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-fab740d5-569a-42a6-a5c8-268ce4a33d58 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:20.525435 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fab740d5-569a-42a6-a5c8-268ce4a33d58 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:20.525952 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fab740d5-569a-42a6-a5c8-268ce4a33d58 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:20.526811 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fab740d5-569a-42a6-a5c8-268ce4a33d58 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:20.527310 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fab740d5-569a-42a6-a5c8-268ce4a33d58 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:20.748883 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-fab740d5-569a-42a6-a5c8-268ce4a33d58 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:20.758610 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-fab740d5-569a-42a6-a5c8-268ce4a33d58 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:20.760310 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-fab740d5-569a-42a6-a5c8-268ce4a33d58 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:20.761632 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-fab740d5-569a-42a6-a5c8-268ce4a33d58 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1724 microversion: 2.20 time: 0.250540 Apr 20 18:39:20.762267 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 471/950] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:20 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:20.979282 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-52925599-8a4f-4711-b189-9403f7801378 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:20.979872 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-52925599-8a4f-4711-b189-9403f7801378 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:20.987889 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-52925599-8a4f-4711-b189-9403f7801378 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:20.988407 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-52925599-8a4f-4711-b189-9403f7801378 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:20.989237 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-52925599-8a4f-4711-b189-9403f7801378 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:20.989759 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-52925599-8a4f-4711-b189-9403f7801378 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:21.201864 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-52925599-8a4f-4711-b189-9403f7801378 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:21.212023 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-52925599-8a4f-4711-b189-9403f7801378 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1755 microversion: 2.1 time: 0.237119 Apr 20 18:39:21.212658 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 480/951] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:20 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1755 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:21.782823 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-deb19cf8-c012-48aa-96be-a09adba691fe tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:21.783500 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-deb19cf8-c012-48aa-96be-a09adba691fe tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:21.791552 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-deb19cf8-c012-48aa-96be-a09adba691fe tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:21.792063 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-deb19cf8-c012-48aa-96be-a09adba691fe tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:21.792926 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-deb19cf8-c012-48aa-96be-a09adba691fe tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:21.793446 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-deb19cf8-c012-48aa-96be-a09adba691fe tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:22.029039 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-deb19cf8-c012-48aa-96be-a09adba691fe tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:22.039735 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-deb19cf8-c012-48aa-96be-a09adba691fe tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:22.041334 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-deb19cf8-c012-48aa-96be-a09adba691fe tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:22.042620 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-deb19cf8-c012-48aa-96be-a09adba691fe tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1745 microversion: 2.20 time: 0.264609 Apr 20 18:39:22.043281 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 472/952] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:21 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1745 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:22.230702 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-967c8cb4-43b7-4c6a-8dd2-4887ffd8051b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:22.231384 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-967c8cb4-43b7-4c6a-8dd2-4887ffd8051b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:22.239753 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-967c8cb4-43b7-4c6a-8dd2-4887ffd8051b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:22.240283 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-967c8cb4-43b7-4c6a-8dd2-4887ffd8051b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:22.241126 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-967c8cb4-43b7-4c6a-8dd2-4887ffd8051b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:22.241652 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-967c8cb4-43b7-4c6a-8dd2-4887ffd8051b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:22.471833 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-967c8cb4-43b7-4c6a-8dd2-4887ffd8051b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:22.482700 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-967c8cb4-43b7-4c6a-8dd2-4887ffd8051b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1755 microversion: 2.1 time: 0.256092 Apr 20 18:39:22.483984 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 481/953] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:22 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1755 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:23.075472 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-19cebac9-daba-4859-a886-1d7e10b967f1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:23.076144 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-19cebac9-daba-4859-a886-1d7e10b967f1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:23.085358 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-19cebac9-daba-4859-a886-1d7e10b967f1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:23.086171 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-19cebac9-daba-4859-a886-1d7e10b967f1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:23.087228 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-19cebac9-daba-4859-a886-1d7e10b967f1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:23.087700 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-19cebac9-daba-4859-a886-1d7e10b967f1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:23.415456 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-19cebac9-daba-4859-a886-1d7e10b967f1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:23.425994 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-19cebac9-daba-4859-a886-1d7e10b967f1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:23.428026 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-19cebac9-daba-4859-a886-1d7e10b967f1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:23.429546 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-19cebac9-daba-4859-a886-1d7e10b967f1 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1740 microversion: 2.20 time: 0.358279 Apr 20 18:39:23.430421 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 473/954] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:23 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1740 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:23.505284 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d7f34c7c-2756-4f0d-ad1d-9282396595f2 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:23.506159 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d7f34c7c-2756-4f0d-ad1d-9282396595f2 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:23.514335 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d7f34c7c-2756-4f0d-ad1d-9282396595f2 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:23.515871 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d7f34c7c-2756-4f0d-ad1d-9282396595f2 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:23.519088 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d7f34c7c-2756-4f0d-ad1d-9282396595f2 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:23.519896 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d7f34c7c-2756-4f0d-ad1d-9282396595f2 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:23.775429 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d7f34c7c-2756-4f0d-ad1d-9282396595f2 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:23.786502 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d7f34c7c-2756-4f0d-ad1d-9282396595f2 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1755 microversion: 2.1 time: 0.285687 Apr 20 18:39:23.787152 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 482/955] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:23 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1755 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:24.459037 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9f67d6f9-d31b-4c1d-b18f-73af7dc6405a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:24.460216 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9f67d6f9-d31b-4c1d-b18f-73af7dc6405a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:24.478464 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9f67d6f9-d31b-4c1d-b18f-73af7dc6405a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:24.479405 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9f67d6f9-d31b-4c1d-b18f-73af7dc6405a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:24.480997 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9f67d6f9-d31b-4c1d-b18f-73af7dc6405a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:24.481937 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9f67d6f9-d31b-4c1d-b18f-73af7dc6405a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:24.804869 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-cb90d7b7-f776-40be-9349-50ffdabfbae0 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:24.805881 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-cb90d7b7-f776-40be-9349-50ffdabfbae0 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:24.821253 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cb90d7b7-f776-40be-9349-50ffdabfbae0 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:24.824426 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cb90d7b7-f776-40be-9349-50ffdabfbae0 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:24.829139 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cb90d7b7-f776-40be-9349-50ffdabfbae0 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:24.829904 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cb90d7b7-f776-40be-9349-50ffdabfbae0 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:25.011928 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9f67d6f9-d31b-4c1d-b18f-73af7dc6405a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:25.027558 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9f67d6f9-d31b-4c1d-b18f-73af7dc6405a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:25.029436 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9f67d6f9-d31b-4c1d-b18f-73af7dc6405a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:25.033122 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9f67d6f9-d31b-4c1d-b18f-73af7dc6405a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1740 microversion: 2.20 time: 0.583485 Apr 20 18:39:25.057529 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 474/956] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:24 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1740 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:25.074926 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-060c4501-93ed-4cc6-8fb3-74475d8a5d6b req-26e4f8e2-f7c2-4767-afcc-11798c01e350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976", "name": "network-vif-plugged", "status": "completed", "tag": "c57f912b-2b41-47e1-bdd2-e6f469efb49c"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:39:25.084365 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:39:25.084365 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:39:25.121822 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-060c4501-93ed-4cc6-8fb3-74475d8a5d6b req-26e4f8e2-f7c2-4767-afcc-11798c01e350 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:25.122328 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-060c4501-93ed-4cc6-8fb3-74475d8a5d6b req-26e4f8e2-f7c2-4767-afcc-11798c01e350 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:25.182279 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-cb90d7b7-f776-40be-9349-50ffdabfbae0 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:25.193661 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-cb90d7b7-f776-40be-9349-50ffdabfbae0 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1755 microversion: 2.1 time: 0.392760 Apr 20 18:39:25.194515 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 483/957] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:24 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1755 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:25.205700 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-060c4501-93ed-4cc6-8fb3-74475d8a5d6b req-26e4f8e2-f7c2-4767-afcc-11798c01e350 service nova] Creating event network-vif-plugged:c57f912b-2b41-47e1-bdd2-e6f469efb49c for instance bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 on hv-cinder-78693 Apr 20 18:39:25.221627 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-060c4501-93ed-4cc6-8fb3-74475d8a5d6b req-26e4f8e2-f7c2-4767-afcc-11798c01e350 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160977 Apr 20 18:39:25.241008 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 475/958] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:39:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:39:26.052928 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8a3569f0-8387-4bce-a811-0d7e079ce917 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:26.053634 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8a3569f0-8387-4bce-a811-0d7e079ce917 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:26.062711 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8a3569f0-8387-4bce-a811-0d7e079ce917 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:26.063047 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8a3569f0-8387-4bce-a811-0d7e079ce917 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:26.063932 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8a3569f0-8387-4bce-a811-0d7e079ce917 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:26.064383 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8a3569f0-8387-4bce-a811-0d7e079ce917 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:26.218306 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7bcc1682-e661-4e1d-82ed-ce2a40bb9dab tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:26.219094 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7bcc1682-e661-4e1d-82ed-ce2a40bb9dab tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:26.232222 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7bcc1682-e661-4e1d-82ed-ce2a40bb9dab tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:26.232745 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7bcc1682-e661-4e1d-82ed-ce2a40bb9dab tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:26.235124 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7bcc1682-e661-4e1d-82ed-ce2a40bb9dab tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:26.235637 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7bcc1682-e661-4e1d-82ed-ce2a40bb9dab tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:26.315043 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8a3569f0-8387-4bce-a811-0d7e079ce917 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:26.325785 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8a3569f0-8387-4bce-a811-0d7e079ce917 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:26.328386 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8a3569f0-8387-4bce-a811-0d7e079ce917 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:26.329700 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8a3569f0-8387-4bce-a811-0d7e079ce917 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1740 microversion: 2.20 time: 0.281000 Apr 20 18:39:26.330518 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 484/959] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:26 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:26.569185 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7bcc1682-e661-4e1d-82ed-ce2a40bb9dab tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:26.582198 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7bcc1682-e661-4e1d-82ed-ce2a40bb9dab tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1755 microversion: 2.1 time: 0.369431 Apr 20 18:39:26.583076 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 476/960] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:26 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1755 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:27.349297 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d7b7252a-699c-47ed-b77c-2c105f2db57d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:27.350790 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d7b7252a-699c-47ed-b77c-2c105f2db57d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:27.360210 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d7b7252a-699c-47ed-b77c-2c105f2db57d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:27.360715 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d7b7252a-699c-47ed-b77c-2c105f2db57d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:27.361590 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d7b7252a-699c-47ed-b77c-2c105f2db57d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:27.362082 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d7b7252a-699c-47ed-b77c-2c105f2db57d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:27.600370 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ed7e1f66-c75a-47ab-910b-cb7943db9b10 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:27.600975 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ed7e1f66-c75a-47ab-910b-cb7943db9b10 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:27.612791 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ed7e1f66-c75a-47ab-910b-cb7943db9b10 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:27.613299 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ed7e1f66-c75a-47ab-910b-cb7943db9b10 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:27.613694 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d7b7252a-699c-47ed-b77c-2c105f2db57d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:27.614203 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ed7e1f66-c75a-47ab-910b-cb7943db9b10 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:27.614702 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ed7e1f66-c75a-47ab-910b-cb7943db9b10 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:27.626987 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d7b7252a-699c-47ed-b77c-2c105f2db57d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:27.629171 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d7b7252a-699c-47ed-b77c-2c105f2db57d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:27.648846 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d7b7252a-699c-47ed-b77c-2c105f2db57d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1740 microversion: 2.20 time: 0.303484 Apr 20 18:39:27.650524 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 485/961] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:27 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1740 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:28.007090 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ed7e1f66-c75a-47ab-910b-cb7943db9b10 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:28.021509 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ed7e1f66-c75a-47ab-910b-cb7943db9b10 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1758 microversion: 2.1 time: 0.424755 Apr 20 18:39:28.022722 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 477/962] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:27 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1758 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:28.669494 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c80fe752-b22a-4415-a771-b236bb71f1bd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:28.670315 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c80fe752-b22a-4415-a771-b236bb71f1bd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:28.679249 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c80fe752-b22a-4415-a771-b236bb71f1bd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:28.679876 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c80fe752-b22a-4415-a771-b236bb71f1bd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:28.680828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c80fe752-b22a-4415-a771-b236bb71f1bd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:28.681437 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c80fe752-b22a-4415-a771-b236bb71f1bd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:28.954781 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c80fe752-b22a-4415-a771-b236bb71f1bd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:28.964812 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c80fe752-b22a-4415-a771-b236bb71f1bd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:28.966531 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c80fe752-b22a-4415-a771-b236bb71f1bd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:28.968489 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c80fe752-b22a-4415-a771-b236bb71f1bd tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1740 microversion: 2.20 time: 0.303154 Apr 20 18:39:28.969245 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 486/963] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:28 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:29.989290 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e8383e6f-e508-49f3-9c99-8a83f46d7a9c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:29.990062 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e8383e6f-e508-49f3-9c99-8a83f46d7a9c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:30.004336 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e8383e6f-e508-49f3-9c99-8a83f46d7a9c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:30.004864 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e8383e6f-e508-49f3-9c99-8a83f46d7a9c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:30.005828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e8383e6f-e508-49f3-9c99-8a83f46d7a9c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:30.006327 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e8383e6f-e508-49f3-9c99-8a83f46d7a9c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:30.288877 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e8383e6f-e508-49f3-9c99-8a83f46d7a9c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:30.300792 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e8383e6f-e508-49f3-9c99-8a83f46d7a9c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:30.302556 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e8383e6f-e508-49f3-9c99-8a83f46d7a9c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:30.303838 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e8383e6f-e508-49f3-9c99-8a83f46d7a9c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1740 microversion: 2.20 time: 0.319263 Apr 20 18:39:30.304727 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 478/964] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:29 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1740 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:31.334136 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a996cee9-19dc-4414-b258-46f300c6aeae tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:31.335968 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a996cee9-19dc-4414-b258-46f300c6aeae tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:31.352345 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a996cee9-19dc-4414-b258-46f300c6aeae tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:31.353147 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a996cee9-19dc-4414-b258-46f300c6aeae tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:31.354239 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a996cee9-19dc-4414-b258-46f300c6aeae tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:31.354895 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a996cee9-19dc-4414-b258-46f300c6aeae tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:31.638594 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a996cee9-19dc-4414-b258-46f300c6aeae tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:31.649275 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a996cee9-19dc-4414-b258-46f300c6aeae tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:31.651111 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a996cee9-19dc-4414-b258-46f300c6aeae tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:31.652364 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a996cee9-19dc-4414-b258-46f300c6aeae tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1740 microversion: 2.20 time: 0.330819 Apr 20 18:39:31.652990 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 487/965] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:31 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1740 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:32.130243 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-dfb732ee-d960-4b18-b17b-e77f7f53546c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:32.131301 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-dfb732ee-d960-4b18-b17b-e77f7f53546c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:32.147958 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dfb732ee-d960-4b18-b17b-e77f7f53546c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:32.148824 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dfb732ee-d960-4b18-b17b-e77f7f53546c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:32.150400 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dfb732ee-d960-4b18-b17b-e77f7f53546c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:32.151228 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dfb732ee-d960-4b18-b17b-e77f7f53546c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:32.232032 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-dfb732ee-d960-4b18-b17b-e77f7f53546c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/os-volume_attachments/ca383b72-848b-452e-8150-f38f10f983bb" status: 200 len: 194 microversion: 2.1 time: 0.111166 Apr 20 18:39:32.232703 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 479/966] 10.222.0.25 () {58 vars in 1403 bytes} [Tue Apr 20 18:39:32 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/os-volume_attachments/ca383b72-848b-452e-8150-f38f10f983bb => generated 194 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:39:32.243545 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1d76440c-9787-4271-bbde-a5823d27803b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:32.244103 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1d76440c-9787-4271-bbde-a5823d27803b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:32.253022 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1d76440c-9787-4271-bbde-a5823d27803b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:32.253576 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1d76440c-9787-4271-bbde-a5823d27803b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:32.254394 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1d76440c-9787-4271-bbde-a5823d27803b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:32.254889 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1d76440c-9787-4271-bbde-a5823d27803b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:32.455921 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-1d76440c-9787-4271-bbde-a5823d27803b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lazy-loading 'services' on Instance uuid 5c83cdcf-5e96-42c2-9143-725c93f9b828 {{(pid=100593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:39:32.605801 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1d76440c-9787-4271-bbde-a5823d27803b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/os-volume_attachments/ca383b72-848b-452e-8150-f38f10f983bb" status: 202 len: 0 microversion: 2.1 time: 0.366077 Apr 20 18:39:32.606526 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 488/967] 10.222.0.25 () {58 vars in 1406 bytes} [Tue Apr 20 18:39:32 2021] DELETE /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/os-volume_attachments/ca383b72-848b-452e-8150-f38f10f983bb => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:39:32.674989 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-28a34ecb-4107-4197-8c83-add03a60555d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:32.675624 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-28a34ecb-4107-4197-8c83-add03a60555d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:32.685704 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-28a34ecb-4107-4197-8c83-add03a60555d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:32.686919 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-28a34ecb-4107-4197-8c83-add03a60555d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:32.687886 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-28a34ecb-4107-4197-8c83-add03a60555d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:32.688590 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-28a34ecb-4107-4197-8c83-add03a60555d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:32.928916 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-28a34ecb-4107-4197-8c83-add03a60555d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:32.940992 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-28a34ecb-4107-4197-8c83-add03a60555d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:32.942771 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-28a34ecb-4107-4197-8c83-add03a60555d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:32.944054 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-28a34ecb-4107-4197-8c83-add03a60555d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1740 microversion: 2.20 time: 0.274836 Apr 20 18:39:32.944935 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 480/968] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:32 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1740 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:33.965487 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e73c18c9-50c3-4f30-b250-19526f6f3d6e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:33.966211 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e73c18c9-50c3-4f30-b250-19526f6f3d6e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:33.975262 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e73c18c9-50c3-4f30-b250-19526f6f3d6e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:33.975766 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e73c18c9-50c3-4f30-b250-19526f6f3d6e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:33.976879 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e73c18c9-50c3-4f30-b250-19526f6f3d6e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:33.977574 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e73c18c9-50c3-4f30-b250-19526f6f3d6e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:34.229203 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e73c18c9-50c3-4f30-b250-19526f6f3d6e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:34.240184 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e73c18c9-50c3-4f30-b250-19526f6f3d6e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:34.241902 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e73c18c9-50c3-4f30-b250-19526f6f3d6e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:34.243136 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e73c18c9-50c3-4f30-b250-19526f6f3d6e tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1722 microversion: 2.20 time: 0.282440 Apr 20 18:39:34.243746 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 489/969] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:33 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:34.938362 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-bcc10f22-66ab-494d-a952-353a5d2fb4ff tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:34.938917 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-bcc10f22-66ab-494d-a952-353a5d2fb4ff tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:34.946881 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bcc10f22-66ab-494d-a952-353a5d2fb4ff tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:34.947390 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bcc10f22-66ab-494d-a952-353a5d2fb4ff tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:34.948230 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bcc10f22-66ab-494d-a952-353a5d2fb4ff tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:34.948721 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bcc10f22-66ab-494d-a952-353a5d2fb4ff tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:35.017268 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-bcc10f22-66ab-494d-a952-353a5d2fb4ff tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/os-volume_attachments/0be84830-0280-4dfe-ac2c-7242b6a8eedc" status: 200 len: 194 microversion: 2.1 time: 0.083892 Apr 20 18:39:35.018161 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 481/970] 10.222.0.25 () {58 vars in 1403 bytes} [Tue Apr 20 18:39:34 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/os-volume_attachments/0be84830-0280-4dfe-ac2c-7242b6a8eedc => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:39:35.028999 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-be0d813e-ef92-4772-a6c7-70e5c48a0ef8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:35.029641 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-be0d813e-ef92-4772-a6c7-70e5c48a0ef8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:35.037609 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-be0d813e-ef92-4772-a6c7-70e5c48a0ef8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:35.038130 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-be0d813e-ef92-4772-a6c7-70e5c48a0ef8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:35.038976 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-be0d813e-ef92-4772-a6c7-70e5c48a0ef8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:35.039501 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-be0d813e-ef92-4772-a6c7-70e5c48a0ef8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:35.215438 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-be0d813e-ef92-4772-a6c7-70e5c48a0ef8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lazy-loading 'services' on Instance uuid 5c83cdcf-5e96-42c2-9143-725c93f9b828 {{(pid=100593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:39:35.263812 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7bf90fdd-f7ed-400f-9fb3-249d14a53a4f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:35.264996 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7bf90fdd-f7ed-400f-9fb3-249d14a53a4f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:35.272960 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7bf90fdd-f7ed-400f-9fb3-249d14a53a4f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:35.273522 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7bf90fdd-f7ed-400f-9fb3-249d14a53a4f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:35.274372 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7bf90fdd-f7ed-400f-9fb3-249d14a53a4f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:35.274872 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7bf90fdd-f7ed-400f-9fb3-249d14a53a4f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:35.360633 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-be0d813e-ef92-4772-a6c7-70e5c48a0ef8 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/os-volume_attachments/0be84830-0280-4dfe-ac2c-7242b6a8eedc" status: 202 len: 0 microversion: 2.1 time: 0.335391 Apr 20 18:39:35.361443 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 490/971] 10.222.0.25 () {58 vars in 1406 bytes} [Tue Apr 20 18:39:35 2021] DELETE /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828/os-volume_attachments/0be84830-0280-4dfe-ac2c-7242b6a8eedc => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:39:35.512133 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7bf90fdd-f7ed-400f-9fb3-249d14a53a4f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:35.522484 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7bf90fdd-f7ed-400f-9fb3-249d14a53a4f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:35.524187 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7bf90fdd-f7ed-400f-9fb3-249d14a53a4f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:35.525538 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7bf90fdd-f7ed-400f-9fb3-249d14a53a4f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1722 microversion: 2.20 time: 0.265904 Apr 20 18:39:35.526180 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 482/972] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:35 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:39:36.546771 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ef3dba97-c6e6-4fc1-95a6-ffc72bc66c22 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:36.547546 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ef3dba97-c6e6-4fc1-95a6-ffc72bc66c22 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:36.556661 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ef3dba97-c6e6-4fc1-95a6-ffc72bc66c22 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:36.556757 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ef3dba97-c6e6-4fc1-95a6-ffc72bc66c22 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:36.557605 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ef3dba97-c6e6-4fc1-95a6-ffc72bc66c22 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:36.558111 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ef3dba97-c6e6-4fc1-95a6-ffc72bc66c22 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:36.805019 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ef3dba97-c6e6-4fc1-95a6-ffc72bc66c22 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:36.823628 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ef3dba97-c6e6-4fc1-95a6-ffc72bc66c22 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:36.825374 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ef3dba97-c6e6-4fc1-95a6-ffc72bc66c22 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:36.826813 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ef3dba97-c6e6-4fc1-95a6-ffc72bc66c22 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1665 microversion: 2.20 time: 0.285202 Apr 20 18:39:36.827442 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 491/973] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:36 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1665 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:36.855090 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-dbda83ea-e3a3-4264-b80e-6a43a805d529 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29819255-ffa9-4120-aa2c-64f381c3d465"}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:39:36.856307 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-dbda83ea-e3a3-4264-b80e-6a43a805d529 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:36.865449 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dbda83ea-e3a3-4264-b80e-6a43a805d529 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:36.866228 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dbda83ea-e3a3-4264-b80e-6a43a805d529 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:36.867268 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dbda83ea-e3a3-4264-b80e-6a43a805d529 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:36.868080 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dbda83ea-e3a3-4264-b80e-6a43a805d529 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:36.877164 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-37de8de7-de5b-45bb-a832-5f35fdad75a1 req-bc40a3d8-368d-4847-9256-c4870bc4636e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976", "name": "network-vif-unplugged", "status": "completed", "tag": "c57f912b-2b41-47e1-bdd2-e6f469efb49c"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:39:36.879599 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:39:36.879599 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:39:36.890042 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-37de8de7-de5b-45bb-a832-5f35fdad75a1 req-bc40a3d8-368d-4847-9256-c4870bc4636e service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:36.890706 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-37de8de7-de5b-45bb-a832-5f35fdad75a1 req-bc40a3d8-368d-4847-9256-c4870bc4636e service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:36.911456 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.compute.server_external_events [req-37de8de7-de5b-45bb-a832-5f35fdad75a1 req-bc40a3d8-368d-4847-9256-c4870bc4636e service nova] Unable to find a host for instance bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976. Dropping event network-vif-unplugged {{(pid=100593) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Apr 20 18:39:36.912622 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-37de8de7-de5b-45bb-a832-5f35fdad75a1 req-bc40a3d8-368d-4847-9256-c4870bc4636e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.042861 Apr 20 18:39:36.913281 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 492/974] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:39:36 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 20 18:39:37.108762 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8b3df56d-5528-4c36-9167-fedb8bcb38f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:37.109535 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8b3df56d-5528-4c36-9167-fedb8bcb38f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:37.117708 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8b3df56d-5528-4c36-9167-fedb8bcb38f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:37.118214 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8b3df56d-5528-4c36-9167-fedb8bcb38f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:37.119059 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8b3df56d-5528-4c36-9167-fedb8bcb38f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:37.119547 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8b3df56d-5528-4c36-9167-fedb8bcb38f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:37.192879 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8b3df56d-5528-4c36-9167-fedb8bcb38f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Going to try to terminate instance {{(pid=100593) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:39:37.336825 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8b3df56d-5528-4c36-9167-fedb8bcb38f0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 204 len: 0 microversion: 2.1 time: 0.232347 Apr 20 18:39:37.337376 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 493/975] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:39:37 2021] DELETE /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 20 18:39:37.348538 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-63397768-2806-4334-883f-86c9163dedef tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:37.349345 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-63397768-2806-4334-883f-86c9163dedef tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:37.358555 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-63397768-2806-4334-883f-86c9163dedef tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:37.359295 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-63397768-2806-4334-883f-86c9163dedef tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:37.360374 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-63397768-2806-4334-883f-86c9163dedef tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:37.360939 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-63397768-2806-4334-883f-86c9163dedef tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:37.378512 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-dbda83ea-e3a3-4264-b80e-6a43a805d529 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.527385 Apr 20 18:39:37.380335 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 483/976] 10.222.0.25 () {62 vars in 1354 bytes} [Tue Apr 20 18:39:36 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/os-volume_attachments => generated 188 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:39:37.558896 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d64d04e5-348f-44db-b871-b6ffaf76509c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:37.559436 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d64d04e5-348f-44db-b871-b6ffaf76509c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:37.567899 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d64d04e5-348f-44db-b871-b6ffaf76509c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:37.568400 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d64d04e5-348f-44db-b871-b6ffaf76509c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:37.569239 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d64d04e5-348f-44db-b871-b6ffaf76509c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:37.569778 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d64d04e5-348f-44db-b871-b6ffaf76509c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:37.653081 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-63397768-2806-4334-883f-86c9163dedef tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:37.662536 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-63397768-2806-4334-883f-86c9163dedef tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1672 microversion: 2.1 time: 0.320097 Apr 20 18:39:37.663400 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 494/977] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:37 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1672 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:39:38.019793 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d64d04e5-348f-44db-b871-b6ffaf76509c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/os-volume_attachments/29819255-ffa9-4120-aa2c-64f381c3d465" status: 202 len: 0 microversion: 2.20 time: 0.465031 Apr 20 18:39:38.020465 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 484/978] 10.222.0.25 () {60 vars in 1447 bytes} [Tue Apr 20 18:39:37 2021] DELETE /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/os-volume_attachments/29819255-ffa9-4120-aa2c-64f381c3d465 => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 20 18:39:38.132650 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-58a62ab1-d7c2-4108-a4f6-6ed40039f0c6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:39:38.133261 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-58a62ab1-d7c2-4108-a4f6-6ed40039f0c6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:38.141820 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-58a62ab1-d7c2-4108-a4f6-6ed40039f0c6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:38.142331 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-58a62ab1-d7c2-4108-a4f6-6ed40039f0c6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:38.143165 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-58a62ab1-d7c2-4108-a4f6-6ed40039f0c6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:38.143655 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-58a62ab1-d7c2-4108-a4f6-6ed40039f0c6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:38.295570 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-58a62ab1-d7c2-4108-a4f6-6ed40039f0c6 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action" status: 202 len: 0 microversion: 2.20 time: 0.167171 Apr 20 18:39:38.296236 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 495/979] 10.222.0.25 () {62 vars in 1309 bytes} [Tue Apr 20 18:39:38 2021] POST /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:39:38.304907 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-cb92eb9f-34bf-4b63-b480-cdcab4cfdc63 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:38.305638 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-cb92eb9f-34bf-4b63-b480-cdcab4cfdc63 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:38.314149 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cb92eb9f-34bf-4b63-b480-cdcab4cfdc63 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:38.314661 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cb92eb9f-34bf-4b63-b480-cdcab4cfdc63 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:38.315498 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cb92eb9f-34bf-4b63-b480-cdcab4cfdc63 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:38.315990 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cb92eb9f-34bf-4b63-b480-cdcab4cfdc63 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:38.681096 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7f7735e9-ded2-4a3c-bae7-90e56759e095 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:38.681737 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7f7735e9-ded2-4a3c-bae7-90e56759e095 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:38.690682 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7f7735e9-ded2-4a3c-bae7-90e56759e095 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:38.691199 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7f7735e9-ded2-4a3c-bae7-90e56759e095 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:38.692059 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7f7735e9-ded2-4a3c-bae7-90e56759e095 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:38.692558 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7f7735e9-ded2-4a3c-bae7-90e56759e095 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:38.872183 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-cb92eb9f-34bf-4b63-b480-cdcab4cfdc63 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:38.884833 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-cb92eb9f-34bf-4b63-b480-cdcab4cfdc63 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:38.886714 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-cb92eb9f-34bf-4b63-b480-cdcab4cfdc63 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:38.887995 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-cb92eb9f-34bf-4b63-b480-cdcab4cfdc63 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1673 microversion: 2.20 time: 0.587296 Apr 20 18:39:38.888809 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 485/980] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:38 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1673 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:38.940582 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7f7735e9-ded2-4a3c-bae7-90e56759e095 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:38.949881 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7f7735e9-ded2-4a3c-bae7-90e56759e095 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1672 microversion: 2.1 time: 0.272814 Apr 20 18:39:38.957823 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 496/981] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:38 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1672 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:39:39.908718 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-34f44b67-8c68-4ed0-ae0a-a1c3bdf5c9ef tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:39.909334 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-34f44b67-8c68-4ed0-ae0a-a1c3bdf5c9ef tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:39.917448 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-34f44b67-8c68-4ed0-ae0a-a1c3bdf5c9ef tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:39.918219 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-34f44b67-8c68-4ed0-ae0a-a1c3bdf5c9ef tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:39.919076 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-34f44b67-8c68-4ed0-ae0a-a1c3bdf5c9ef tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:39.919571 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-34f44b67-8c68-4ed0-ae0a-a1c3bdf5c9ef tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:39.969018 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0783c49a-11d3-4144-b4f9-8997422c51d0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:39.969728 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0783c49a-11d3-4144-b4f9-8997422c51d0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:39.985009 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0783c49a-11d3-4144-b4f9-8997422c51d0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:39.985965 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0783c49a-11d3-4144-b4f9-8997422c51d0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:39.987227 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0783c49a-11d3-4144-b4f9-8997422c51d0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:39.988225 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0783c49a-11d3-4144-b4f9-8997422c51d0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:40.324937 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-34f44b67-8c68-4ed0-ae0a-a1c3bdf5c9ef tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:40.345026 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-34f44b67-8c68-4ed0-ae0a-a1c3bdf5c9ef tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:40.348859 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-34f44b67-8c68-4ed0-ae0a-a1c3bdf5c9ef tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:40.351753 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-34f44b67-8c68-4ed0-ae0a-a1c3bdf5c9ef tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1675 microversion: 2.20 time: 0.447074 Apr 20 18:39:40.352533 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0783c49a-11d3-4144-b4f9-8997422c51d0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:40.362800 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 486/982] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:39 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1675 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:40.364464 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0783c49a-11d3-4144-b4f9-8997422c51d0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1672 microversion: 2.1 time: 0.399929 Apr 20 18:39:40.365361 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 497/983] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:39 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1672 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:41.007365 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-6d5b86d6-b28f-487a-a610-4b193f961e3a req-4c813a87-61e8-4303-8719-c6847bb51ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c83cdcf-5e96-42c2-9143-725c93f9b828", "name": "network-vif-deleted", "tag": "4a4c411b-0c6c-4e00-aba6-9fe7f06a9c10"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:39:41.009183 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:39:41.009183 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:39:41.020137 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-6d5b86d6-b28f-487a-a610-4b193f961e3a req-4c813a87-61e8-4303-8719-c6847bb51ab3 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:41.020665 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-6d5b86d6-b28f-487a-a610-4b193f961e3a req-4c813a87-61e8-4303-8719-c6847bb51ab3 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:41.040079 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-6d5b86d6-b28f-487a-a610-4b193f961e3a req-4c813a87-61e8-4303-8719-c6847bb51ab3 service nova] Creating event network-vif-deleted:4a4c411b-0c6c-4e00-aba6-9fe7f06a9c10 for instance 5c83cdcf-5e96-42c2-9143-725c93f9b828 on hv-cinder-78693 Apr 20 18:39:41.045511 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-6d5b86d6-b28f-487a-a610-4b193f961e3a req-4c813a87-61e8-4303-8719-c6847bb51ab3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041967 Apr 20 18:39:41.046181 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 487/984] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:39:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:39:41.372497 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-61141ab2-0ba8-4507-a047-fc0c3443c089 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:41.374161 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-61141ab2-0ba8-4507-a047-fc0c3443c089 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:41.383672 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-61141ab2-0ba8-4507-a047-fc0c3443c089 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:41.384147 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-61141ab2-0ba8-4507-a047-fc0c3443c089 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:41.385202 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-61141ab2-0ba8-4507-a047-fc0c3443c089 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:41.385889 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-61141ab2-0ba8-4507-a047-fc0c3443c089 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:41.386741 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-989a7761-5c06-4093-8988-23864650f15e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:41.391739 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-989a7761-5c06-4093-8988-23864650f15e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:41.408172 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-989a7761-5c06-4093-8988-23864650f15e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:41.413794 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-989a7761-5c06-4093-8988-23864650f15e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:41.414918 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-989a7761-5c06-4093-8988-23864650f15e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:41.415507 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-989a7761-5c06-4093-8988-23864650f15e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:41.537069 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-989a7761-5c06-4093-8988-23864650f15e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:41.537960 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-989a7761-5c06-4093-8988-23864650f15e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:41.538756 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-989a7761-5c06-4093-8988-23864650f15e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lazy-loading 'fault' on Instance uuid 5c83cdcf-5e96-42c2-9143-725c93f9b828 {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:39:41.664911 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-989a7761-5c06-4093-8988-23864650f15e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:41.687825 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-989a7761-5c06-4093-8988-23864650f15e tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1325 microversion: 2.1 time: 0.307696 Apr 20 18:39:41.688791 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 488/985] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:41 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1325 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:41.808754 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-61141ab2-0ba8-4507-a047-fc0c3443c089 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:41.822043 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-61141ab2-0ba8-4507-a047-fc0c3443c089 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:41.824030 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-61141ab2-0ba8-4507-a047-fc0c3443c089 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:41.825930 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-61141ab2-0ba8-4507-a047-fc0c3443c089 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1731 microversion: 2.20 time: 0.457581 Apr 20 18:39:41.827622 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 498/986] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:41 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1731 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:42.708706 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-eb4e4e8a-7d0a-4ec9-bb3b-e708024c169b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:42.710018 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-eb4e4e8a-7d0a-4ec9-bb3b-e708024c169b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:42.719797 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eb4e4e8a-7d0a-4ec9-bb3b-e708024c169b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:42.720395 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eb4e4e8a-7d0a-4ec9-bb3b-e708024c169b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:42.721160 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eb4e4e8a-7d0a-4ec9-bb3b-e708024c169b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:42.721684 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eb4e4e8a-7d0a-4ec9-bb3b-e708024c169b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:42.822878 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eb4e4e8a-7d0a-4ec9-bb3b-e708024c169b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:42.823393 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eb4e4e8a-7d0a-4ec9-bb3b-e708024c169b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:42.823926 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-eb4e4e8a-7d0a-4ec9-bb3b-e708024c169b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lazy-loading 'fault' on Instance uuid 5c83cdcf-5e96-42c2-9143-725c93f9b828 {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:39:42.846455 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-678cb0ab-eb89-43f7-b2a6-f80aab0ec9f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:42.847300 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-678cb0ab-eb89-43f7-b2a6-f80aab0ec9f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:42.857331 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-678cb0ab-eb89-43f7-b2a6-f80aab0ec9f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:42.858209 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-678cb0ab-eb89-43f7-b2a6-f80aab0ec9f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:42.859239 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-678cb0ab-eb89-43f7-b2a6-f80aab0ec9f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:42.860370 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-678cb0ab-eb89-43f7-b2a6-f80aab0ec9f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:42.901901 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-eb4e4e8a-7d0a-4ec9-bb3b-e708024c169b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:42.912381 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-eb4e4e8a-7d0a-4ec9-bb3b-e708024c169b tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1325 microversion: 2.1 time: 0.207604 Apr 20 18:39:42.913709 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 489/987] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:42 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1325 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:43.104238 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-678cb0ab-eb89-43f7-b2a6-f80aab0ec9f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:43.121657 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-678cb0ab-eb89-43f7-b2a6-f80aab0ec9f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:43.123887 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-678cb0ab-eb89-43f7-b2a6-f80aab0ec9f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:43.125514 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-678cb0ab-eb89-43f7-b2a6-f80aab0ec9f4 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1731 microversion: 2.20 time: 0.283049 Apr 20 18:39:43.126363 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 499/988] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:42 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1731 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:43.931942 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2c40c351-f29b-4a8f-b3f5-58bf9aef8394 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:43.932603 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2c40c351-f29b-4a8f-b3f5-58bf9aef8394 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:43.942096 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2c40c351-f29b-4a8f-b3f5-58bf9aef8394 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:43.942608 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2c40c351-f29b-4a8f-b3f5-58bf9aef8394 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:43.943485 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2c40c351-f29b-4a8f-b3f5-58bf9aef8394 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:43.943968 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2c40c351-f29b-4a8f-b3f5-58bf9aef8394 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:44.025473 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2c40c351-f29b-4a8f-b3f5-58bf9aef8394 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:44.025988 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2c40c351-f29b-4a8f-b3f5-58bf9aef8394 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:44.026516 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-2c40c351-f29b-4a8f-b3f5-58bf9aef8394 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lazy-loading 'fault' on Instance uuid 5c83cdcf-5e96-42c2-9143-725c93f9b828 {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:39:44.100838 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2c40c351-f29b-4a8f-b3f5-58bf9aef8394 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:44.110853 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2c40c351-f29b-4a8f-b3f5-58bf9aef8394 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1325 microversion: 2.1 time: 0.183485 Apr 20 18:39:44.111517 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 490/989] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:43 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1325 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:44.147164 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0e0dd1c6-0422-4a65-ae40-fcc8f543ca5d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:44.147859 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0e0dd1c6-0422-4a65-ae40-fcc8f543ca5d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:44.156938 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0e0dd1c6-0422-4a65-ae40-fcc8f543ca5d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:44.157484 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0e0dd1c6-0422-4a65-ae40-fcc8f543ca5d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:44.158391 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0e0dd1c6-0422-4a65-ae40-fcc8f543ca5d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:44.158895 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0e0dd1c6-0422-4a65-ae40-fcc8f543ca5d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:44.394556 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0e0dd1c6-0422-4a65-ae40-fcc8f543ca5d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:44.405252 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0e0dd1c6-0422-4a65-ae40-fcc8f543ca5d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:44.407835 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0e0dd1c6-0422-4a65-ae40-fcc8f543ca5d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:44.408581 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0e0dd1c6-0422-4a65-ae40-fcc8f543ca5d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1731 microversion: 2.20 time: 0.265962 Apr 20 18:39:44.409227 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 500/990] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:44 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1731 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:45.131949 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-09bcbdc2-f1e7-4e70-978b-b61ad90563c1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:45.133336 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-09bcbdc2-f1e7-4e70-978b-b61ad90563c1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:45.142960 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-09bcbdc2-f1e7-4e70-978b-b61ad90563c1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:45.143474 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-09bcbdc2-f1e7-4e70-978b-b61ad90563c1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:45.144333 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-09bcbdc2-f1e7-4e70-978b-b61ad90563c1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:45.144828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-09bcbdc2-f1e7-4e70-978b-b61ad90563c1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:45.226914 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-09bcbdc2-f1e7-4e70-978b-b61ad90563c1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:45.227431 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-09bcbdc2-f1e7-4e70-978b-b61ad90563c1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:45.228006 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-09bcbdc2-f1e7-4e70-978b-b61ad90563c1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lazy-loading 'fault' on Instance uuid 5c83cdcf-5e96-42c2-9143-725c93f9b828 {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:39:45.293998 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-09bcbdc2-f1e7-4e70-978b-b61ad90563c1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:45.304360 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-09bcbdc2-f1e7-4e70-978b-b61ad90563c1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1325 microversion: 2.1 time: 0.177780 Apr 20 18:39:45.305203 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 491/991] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:45 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1325 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:45.427908 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-fd46f9e4-79db-4e72-abd7-48485f98f7f0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:45.428587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-fd46f9e4-79db-4e72-abd7-48485f98f7f0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:45.437171 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fd46f9e4-79db-4e72-abd7-48485f98f7f0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:45.437698 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fd46f9e4-79db-4e72-abd7-48485f98f7f0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:45.438536 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fd46f9e4-79db-4e72-abd7-48485f98f7f0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:45.439024 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fd46f9e4-79db-4e72-abd7-48485f98f7f0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:45.680219 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-fd46f9e4-79db-4e72-abd7-48485f98f7f0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:45.692050 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-fd46f9e4-79db-4e72-abd7-48485f98f7f0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:45.693826 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-fd46f9e4-79db-4e72-abd7-48485f98f7f0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:45.695064 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-fd46f9e4-79db-4e72-abd7-48485f98f7f0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1731 microversion: 2.20 time: 0.271355 Apr 20 18:39:45.695696 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 501/992] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:45 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1731 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:46.324111 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4548d088-0061-4771-8d49-031519bd433a tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:46.324516 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4548d088-0061-4771-8d49-031519bd433a tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:46.335266 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4548d088-0061-4771-8d49-031519bd433a tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:46.336233 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4548d088-0061-4771-8d49-031519bd433a tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:46.338096 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4548d088-0061-4771-8d49-031519bd433a tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:46.338945 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4548d088-0061-4771-8d49-031519bd433a tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:46.425943 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4548d088-0061-4771-8d49-031519bd433a tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:46.426501 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4548d088-0061-4771-8d49-031519bd433a tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:46.427028 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-4548d088-0061-4771-8d49-031519bd433a tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lazy-loading 'fault' on Instance uuid 5c83cdcf-5e96-42c2-9143-725c93f9b828 {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:39:46.498824 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4548d088-0061-4771-8d49-031519bd433a tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:46.508788 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4548d088-0061-4771-8d49-031519bd433a tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1325 microversion: 2.1 time: 0.189209 Apr 20 18:39:46.510795 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 492/993] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:46 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1325 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:46.715283 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e283f6aa-77e5-48a5-a625-78f012c9b53b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:46.715890 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e283f6aa-77e5-48a5-a625-78f012c9b53b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:46.724701 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e283f6aa-77e5-48a5-a625-78f012c9b53b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:46.725181 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e283f6aa-77e5-48a5-a625-78f012c9b53b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:46.726086 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e283f6aa-77e5-48a5-a625-78f012c9b53b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:46.726851 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e283f6aa-77e5-48a5-a625-78f012c9b53b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:46.983425 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e283f6aa-77e5-48a5-a625-78f012c9b53b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:46.993175 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e283f6aa-77e5-48a5-a625-78f012c9b53b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:46.994893 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e283f6aa-77e5-48a5-a625-78f012c9b53b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:46.996129 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e283f6aa-77e5-48a5-a625-78f012c9b53b tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1731 microversion: 2.20 time: 0.285299 Apr 20 18:39:46.996767 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 502/994] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:46 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1731 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:47.528506 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-88526544-8d5b-4c7e-bab8-cf8319658097 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:47.529236 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-88526544-8d5b-4c7e-bab8-cf8319658097 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:47.537406 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-88526544-8d5b-4c7e-bab8-cf8319658097 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:47.537934 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-88526544-8d5b-4c7e-bab8-cf8319658097 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:47.538773 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-88526544-8d5b-4c7e-bab8-cf8319658097 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:47.539261 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-88526544-8d5b-4c7e-bab8-cf8319658097 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:47.619308 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-88526544-8d5b-4c7e-bab8-cf8319658097 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:47.619811 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-88526544-8d5b-4c7e-bab8-cf8319658097 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:47.620309 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-88526544-8d5b-4c7e-bab8-cf8319658097 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lazy-loading 'fault' on Instance uuid 5c83cdcf-5e96-42c2-9143-725c93f9b828 {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:39:47.692501 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-88526544-8d5b-4c7e-bab8-cf8319658097 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:47.702114 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-88526544-8d5b-4c7e-bab8-cf8319658097 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1325 microversion: 2.1 time: 0.177711 Apr 20 18:39:47.702753 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 493/995] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:47 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1325 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:48.019273 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-573f22f9-9268-41a9-acd5-ba29f9a5e03a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:48.019931 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-573f22f9-9268-41a9-acd5-ba29f9a5e03a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:48.027786 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-573f22f9-9268-41a9-acd5-ba29f9a5e03a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:48.028288 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-573f22f9-9268-41a9-acd5-ba29f9a5e03a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:48.029189 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-573f22f9-9268-41a9-acd5-ba29f9a5e03a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:48.029730 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-573f22f9-9268-41a9-acd5-ba29f9a5e03a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:48.504110 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-573f22f9-9268-41a9-acd5-ba29f9a5e03a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:48.516200 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-573f22f9-9268-41a9-acd5-ba29f9a5e03a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:48.518096 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-573f22f9-9268-41a9-acd5-ba29f9a5e03a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:48.519378 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-573f22f9-9268-41a9-acd5-ba29f9a5e03a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1731 microversion: 2.20 time: 0.504383 Apr 20 18:39:48.520026 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 503/996] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:48 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1731 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:48.721002 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5a84ab66-cb18-46f2-8d17-7311de58f386 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:48.721724 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5a84ab66-cb18-46f2-8d17-7311de58f386 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:48.731190 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a84ab66-cb18-46f2-8d17-7311de58f386 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:48.731708 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a84ab66-cb18-46f2-8d17-7311de58f386 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:48.733422 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a84ab66-cb18-46f2-8d17-7311de58f386 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:48.734295 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a84ab66-cb18-46f2-8d17-7311de58f386 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:48.817849 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a84ab66-cb18-46f2-8d17-7311de58f386 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:48.818370 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a84ab66-cb18-46f2-8d17-7311de58f386 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:48.818895 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-5a84ab66-cb18-46f2-8d17-7311de58f386 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lazy-loading 'fault' on Instance uuid 5c83cdcf-5e96-42c2-9143-725c93f9b828 {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:39:48.885648 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5a84ab66-cb18-46f2-8d17-7311de58f386 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:48.897427 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5a84ab66-cb18-46f2-8d17-7311de58f386 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1325 microversion: 2.1 time: 0.181300 Apr 20 18:39:48.898415 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 494/997] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:48 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1325 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:49.540450 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-11a05cca-011f-44fc-a06a-bfcf9652f656 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:49.541122 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-11a05cca-011f-44fc-a06a-bfcf9652f656 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:49.550028 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-11a05cca-011f-44fc-a06a-bfcf9652f656 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:49.550543 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-11a05cca-011f-44fc-a06a-bfcf9652f656 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:49.551398 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-11a05cca-011f-44fc-a06a-bfcf9652f656 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:49.551893 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-11a05cca-011f-44fc-a06a-bfcf9652f656 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:49.790027 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-11a05cca-011f-44fc-a06a-bfcf9652f656 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:49.800220 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-11a05cca-011f-44fc-a06a-bfcf9652f656 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:49.802026 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-11a05cca-011f-44fc-a06a-bfcf9652f656 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:49.803306 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-11a05cca-011f-44fc-a06a-bfcf9652f656 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1731 microversion: 2.20 time: 0.266934 Apr 20 18:39:49.803949 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 504/998] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:49 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1731 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:49.916092 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-951063ca-5d3a-43f6-ad5c-54f60f11cf03 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:49.916815 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-951063ca-5d3a-43f6-ad5c-54f60f11cf03 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:49.925470 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-951063ca-5d3a-43f6-ad5c-54f60f11cf03 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:49.925986 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-951063ca-5d3a-43f6-ad5c-54f60f11cf03 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:49.926946 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-951063ca-5d3a-43f6-ad5c-54f60f11cf03 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:49.927442 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-951063ca-5d3a-43f6-ad5c-54f60f11cf03 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:50.011288 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-951063ca-5d3a-43f6-ad5c-54f60f11cf03 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:50.011709 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-951063ca-5d3a-43f6-ad5c-54f60f11cf03 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:50.012233 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-951063ca-5d3a-43f6-ad5c-54f60f11cf03 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lazy-loading 'fault' on Instance uuid 5c83cdcf-5e96-42c2-9143-725c93f9b828 {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:39:50.091743 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-951063ca-5d3a-43f6-ad5c-54f60f11cf03 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:50.102640 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-951063ca-5d3a-43f6-ad5c-54f60f11cf03 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1325 microversion: 2.1 time: 0.190647 Apr 20 18:39:50.103466 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 495/999] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:49 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1325 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:50.823868 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c6d33b79-0dce-4a34-a14f-d1d39da77cd2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:50.824592 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c6d33b79-0dce-4a34-a14f-d1d39da77cd2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:50.833287 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c6d33b79-0dce-4a34-a14f-d1d39da77cd2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:50.833832 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c6d33b79-0dce-4a34-a14f-d1d39da77cd2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:50.834683 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c6d33b79-0dce-4a34-a14f-d1d39da77cd2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:50.835178 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c6d33b79-0dce-4a34-a14f-d1d39da77cd2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:51.093233 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c6d33b79-0dce-4a34-a14f-d1d39da77cd2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:51.103738 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c6d33b79-0dce-4a34-a14f-d1d39da77cd2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:51.105443 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c6d33b79-0dce-4a34-a14f-d1d39da77cd2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:51.106937 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c6d33b79-0dce-4a34-a14f-d1d39da77cd2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1731 microversion: 2.20 time: 0.287185 Apr 20 18:39:51.107987 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 505/1000] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:50 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1731 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:51.120688 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c3e1db57-71ad-49b7-869d-ea52d0d6f4c5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:51.121360 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c3e1db57-71ad-49b7-869d-ea52d0d6f4c5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:51.130520 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c3e1db57-71ad-49b7-869d-ea52d0d6f4c5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:51.131035 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c3e1db57-71ad-49b7-869d-ea52d0d6f4c5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:51.131883 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c3e1db57-71ad-49b7-869d-ea52d0d6f4c5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:51.132381 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c3e1db57-71ad-49b7-869d-ea52d0d6f4c5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:51.213994 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c3e1db57-71ad-49b7-869d-ea52d0d6f4c5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:51.214508 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c3e1db57-71ad-49b7-869d-ea52d0d6f4c5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:51.215030 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-c3e1db57-71ad-49b7-869d-ea52d0d6f4c5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lazy-loading 'fault' on Instance uuid 5c83cdcf-5e96-42c2-9143-725c93f9b828 {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:39:51.288357 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c3e1db57-71ad-49b7-869d-ea52d0d6f4c5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:51.299283 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c3e1db57-71ad-49b7-869d-ea52d0d6f4c5 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1325 microversion: 2.1 time: 0.182619 Apr 20 18:39:51.300221 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 496/1001] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:51 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1325 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:39:52.127263 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-09d9654e-2a2f-4fb7-9d16-4abf2d208876 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:52.127934 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-09d9654e-2a2f-4fb7-9d16-4abf2d208876 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:52.135894 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-09d9654e-2a2f-4fb7-9d16-4abf2d208876 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:52.136403 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-09d9654e-2a2f-4fb7-9d16-4abf2d208876 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:52.137235 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-09d9654e-2a2f-4fb7-9d16-4abf2d208876 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:52.137748 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-09d9654e-2a2f-4fb7-9d16-4abf2d208876 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:52.317057 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ad4dde63-048a-427b-b072-8a445bee21e0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:52.318015 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ad4dde63-048a-427b-b072-8a445bee21e0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:52.327498 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ad4dde63-048a-427b-b072-8a445bee21e0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:52.328017 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ad4dde63-048a-427b-b072-8a445bee21e0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:52.328878 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ad4dde63-048a-427b-b072-8a445bee21e0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:52.329377 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ad4dde63-048a-427b-b072-8a445bee21e0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:52.355611 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-09d9654e-2a2f-4fb7-9d16-4abf2d208876 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:52.365599 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-09d9654e-2a2f-4fb7-9d16-4abf2d208876 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:52.367281 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-09d9654e-2a2f-4fb7-9d16-4abf2d208876 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:52.368520 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-09d9654e-2a2f-4fb7-9d16-4abf2d208876 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1731 microversion: 2.20 time: 0.245434 Apr 20 18:39:52.369147 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 506/1002] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:52 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1731 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:52.411473 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ad4dde63-048a-427b-b072-8a445bee21e0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:52.412033 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ad4dde63-048a-427b-b072-8a445bee21e0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:52.412556 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-ad4dde63-048a-427b-b072-8a445bee21e0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lazy-loading 'fault' on Instance uuid 5c83cdcf-5e96-42c2-9143-725c93f9b828 {{(pid=100592) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:39:52.478317 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ad4dde63-048a-427b-b072-8a445bee21e0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a26e5925ce4f50ab72f8d18670edd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379c1b40340b46408792cb7d852bbba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:52.487681 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ad4dde63-048a-427b-b072-8a445bee21e0 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 200 len: 1325 microversion: 2.1 time: 0.174685 Apr 20 18:39:52.488320 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 497/1003] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:52 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 1325 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:39:53.388495 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-bac9e8ef-5359-43d4-96a7-cc8538d4dc27 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:53.389171 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-bac9e8ef-5359-43d4-96a7-cc8538d4dc27 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:53.397319 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bac9e8ef-5359-43d4-96a7-cc8538d4dc27 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:53.397863 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bac9e8ef-5359-43d4-96a7-cc8538d4dc27 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:53.398742 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bac9e8ef-5359-43d4-96a7-cc8538d4dc27 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:53.399242 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bac9e8ef-5359-43d4-96a7-cc8538d4dc27 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:53.505616 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f97f6a87-2707-4516-ad5b-b5375c62410d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:53.506462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f97f6a87-2707-4516-ad5b-b5375c62410d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:53.514456 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f97f6a87-2707-4516-ad5b-b5375c62410d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:53.514957 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f97f6a87-2707-4516-ad5b-b5375c62410d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:53.515798 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f97f6a87-2707-4516-ad5b-b5375c62410d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:53.516290 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f97f6a87-2707-4516-ad5b-b5375c62410d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:53.570523 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-f97f6a87-2707-4516-ad5b-b5375c62410d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] HTTP exception thrown: Instance 5c83cdcf-5e96-42c2-9143-725c93f9b828 could not be found. Apr 20 18:39:53.571200 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f97f6a87-2707-4516-ad5b-b5375c62410d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Returning 404 to user: Instance 5c83cdcf-5e96-42c2-9143-725c93f9b828 could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:39:53.572120 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f97f6a87-2707-4516-ad5b-b5375c62410d tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 404 len: 111 microversion: 2.1 time: 0.070903 Apr 20 18:39:53.572753 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 498/1004] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:53 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 18:39:53.582041 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2450fa7d-408f-40a0-bbcc-5914be89bfc4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '.version_select at 0x7f418d837950>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:53.599137 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2450fa7d-408f-40a0-bbcc-5914be89bfc4 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-573190554" status: 202 len: 0 microversion: 2.1 time: 0.020860 Apr 20 18:39:53.600127 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 499/1005] 10.222.0.25 () {58 vars in 1208 bytes} [Tue Apr 20 18:39:53 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-573190554 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:39:53.625764 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-bac9e8ef-5359-43d4-96a7-cc8538d4dc27 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:53.635358 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-bac9e8ef-5359-43d4-96a7-cc8538d4dc27 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:53.637035 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-bac9e8ef-5359-43d4-96a7-cc8538d4dc27 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:53.638321 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-bac9e8ef-5359-43d4-96a7-cc8538d4dc27 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1731 microversion: 2.20 time: 0.253938 Apr 20 18:39:53.639536 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 507/1006] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:53 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1731 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:54.659534 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d4c4f140-ba7e-4aaa-846d-4950f5ede36c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:54.660219 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d4c4f140-ba7e-4aaa-846d-4950f5ede36c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:54.668980 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d4c4f140-ba7e-4aaa-846d-4950f5ede36c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:54.669521 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d4c4f140-ba7e-4aaa-846d-4950f5ede36c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:54.670987 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d4c4f140-ba7e-4aaa-846d-4950f5ede36c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:54.671481 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d4c4f140-ba7e-4aaa-846d-4950f5ede36c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:54.897680 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d4c4f140-ba7e-4aaa-846d-4950f5ede36c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:54.907405 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d4c4f140-ba7e-4aaa-846d-4950f5ede36c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:54.909061 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d4c4f140-ba7e-4aaa-846d-4950f5ede36c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:54.910289 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d4c4f140-ba7e-4aaa-846d-4950f5ede36c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1731 microversion: 2.20 time: 0.255036 Apr 20 18:39:54.910912 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 500/1007] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:54 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1731 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:55.929667 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4c4f219c-7323-4464-ab43-6ab9e75bb369 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:55.930273 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4c4f219c-7323-4464-ab43-6ab9e75bb369 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:55.939219 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4c4f219c-7323-4464-ab43-6ab9e75bb369 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:55.939745 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4c4f219c-7323-4464-ab43-6ab9e75bb369 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:55.940600 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4c4f219c-7323-4464-ab43-6ab9e75bb369 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:55.941097 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4c4f219c-7323-4464-ab43-6ab9e75bb369 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:56.158075 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4c4f219c-7323-4464-ab43-6ab9e75bb369 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:56.167496 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4c4f219c-7323-4464-ab43-6ab9e75bb369 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:56.169218 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4c4f219c-7323-4464-ab43-6ab9e75bb369 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:56.171006 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4c4f219c-7323-4464-ab43-6ab9e75bb369 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1731 microversion: 2.20 time: 0.245636 Apr 20 18:39:56.171607 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 508/1008] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:55 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1731 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:57.180989 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-02499b4c-a1f0-4b99-a95f-f0a69e2bb15c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:57.181594 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-02499b4c-a1f0-4b99-a95f-f0a69e2bb15c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:57.190932 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-02499b4c-a1f0-4b99-a95f-f0a69e2bb15c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:57.191280 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9d8e44c5-9d1f-4fce-98d4-ce6ccebfad96 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:57.191406 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-02499b4c-a1f0-4b99-a95f-f0a69e2bb15c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:57.191942 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9d8e44c5-9d1f-4fce-98d4-ce6ccebfad96 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:57.192258 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-02499b4c-a1f0-4b99-a95f-f0a69e2bb15c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:57.192748 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-02499b4c-a1f0-4b99-a95f-f0a69e2bb15c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:57.200549 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9d8e44c5-9d1f-4fce-98d4-ce6ccebfad96 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:57.200764 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9d8e44c5-9d1f-4fce-98d4-ce6ccebfad96 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:57.202260 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9d8e44c5-9d1f-4fce-98d4-ce6ccebfad96 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:57.202705 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9d8e44c5-9d1f-4fce-98d4-ce6ccebfad96 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:57.245906 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-02499b4c-a1f0-4b99-a95f-f0a69e2bb15c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] HTTP exception thrown: Instance 5c83cdcf-5e96-42c2-9143-725c93f9b828 could not be found. Apr 20 18:39:57.246575 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-02499b4c-a1f0-4b99-a95f-f0a69e2bb15c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Returning 404 to user: Instance 5c83cdcf-5e96-42c2-9143-725c93f9b828 could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:39:57.247481 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-02499b4c-a1f0-4b99-a95f-f0a69e2bb15c tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 404 len: 111 microversion: 2.1 time: 0.070956 Apr 20 18:39:57.248773 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 501/1009] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:39:57 2021] DELETE /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:39:57.256965 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-48c0310f-b184-49c0-a399-0756eb8c40f1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:57.257664 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-48c0310f-b184-49c0-a399-0756eb8c40f1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 5c83cdcf-5e96-42c2-9143-725c93f9b828] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:57.266595 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-48c0310f-b184-49c0-a399-0756eb8c40f1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:57.267100 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-48c0310f-b184-49c0-a399-0756eb8c40f1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:57.267945 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-48c0310f-b184-49c0-a399-0756eb8c40f1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:57.268419 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-48c0310f-b184-49c0-a399-0756eb8c40f1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:57.328582 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-48c0310f-b184-49c0-a399-0756eb8c40f1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] HTTP exception thrown: Instance 5c83cdcf-5e96-42c2-9143-725c93f9b828 could not be found. Apr 20 18:39:57.329256 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-48c0310f-b184-49c0-a399-0756eb8c40f1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Returning 404 to user: Instance 5c83cdcf-5e96-42c2-9143-725c93f9b828 could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:39:57.330202 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-48c0310f-b184-49c0-a399-0756eb8c40f1 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828" status: 404 len: 111 microversion: 2.1 time: 0.077035 Apr 20 18:39:57.330837 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 502/1010] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:57 2021] GET /compute/v2.1/servers/5c83cdcf-5e96-42c2-9143-725c93f9b828 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 18:39:57.431722 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9d8e44c5-9d1f-4fce-98d4-ce6ccebfad96 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:57.444107 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9d8e44c5-9d1f-4fce-98d4-ce6ccebfad96 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:57.446049 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9d8e44c5-9d1f-4fce-98d4-ce6ccebfad96 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:57.447447 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9d8e44c5-9d1f-4fce-98d4-ce6ccebfad96 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1731 microversion: 2.20 time: 0.260468 Apr 20 18:39:57.448209 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 509/1011] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:57 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1731 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:58.469879 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-61123654-e51f-4d34-98aa-9187c5590066 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:58.470562 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-61123654-e51f-4d34-98aa-9187c5590066 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:58.478843 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-61123654-e51f-4d34-98aa-9187c5590066 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:58.479347 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-61123654-e51f-4d34-98aa-9187c5590066 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:58.480192 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-61123654-e51f-4d34-98aa-9187c5590066 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:58.480685 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-61123654-e51f-4d34-98aa-9187c5590066 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:58.584815 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-10cb6323-d733-4cd1-a7f5-b058d2c0d396 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:58.585544 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-10cb6323-d733-4cd1-a7f5-b058d2c0d396 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:58.594262 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-10cb6323-d733-4cd1-a7f5-b058d2c0d396 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:58.594785 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-10cb6323-d733-4cd1-a7f5-b058d2c0d396 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:58.595619 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-10cb6323-d733-4cd1-a7f5-b058d2c0d396 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:58.596106 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-10cb6323-d733-4cd1-a7f5-b058d2c0d396 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:58.651700 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-10cb6323-d733-4cd1-a7f5-b058d2c0d396 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] HTTP exception thrown: Instance 3b71640b-07ee-4677-8477-21da0a4166b1 could not be found. Apr 20 18:39:58.652366 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-10cb6323-d733-4cd1-a7f5-b058d2c0d396 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Returning 404 to user: Instance 3b71640b-07ee-4677-8477-21da0a4166b1 could not be found. {{(pid=100593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:39:58.653261 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-10cb6323-d733-4cd1-a7f5-b058d2c0d396 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 404 len: 111 microversion: 2.1 time: 0.072658 Apr 20 18:39:58.654451 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 510/1012] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:39:58 2021] DELETE /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:39:58.662445 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3715d069-4692-4e27-9203-9b6c738a0e03 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:58.663112 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3715d069-4692-4e27-9203-9b6c738a0e03 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] [instance: 3b71640b-07ee-4677-8477-21da0a4166b1] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:58.671872 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3715d069-4692-4e27-9203-9b6c738a0e03 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:58.672425 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3715d069-4692-4e27-9203-9b6c738a0e03 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:58.673253 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3715d069-4692-4e27-9203-9b6c738a0e03 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:58.673772 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3715d069-4692-4e27-9203-9b6c738a0e03 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:58.702828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-61123654-e51f-4d34-98aa-9187c5590066 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:58.712515 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-61123654-e51f-4d34-98aa-9187c5590066 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:58.714285 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-61123654-e51f-4d34-98aa-9187c5590066 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:58.715519 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-61123654-e51f-4d34-98aa-9187c5590066 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1731 microversion: 2.20 time: 0.251180 Apr 20 18:39:58.716879 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 503/1013] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:58 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1731 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:39:58.727125 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-3715d069-4692-4e27-9203-9b6c738a0e03 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] HTTP exception thrown: Instance 3b71640b-07ee-4677-8477-21da0a4166b1 could not be found. Apr 20 18:39:58.727789 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3715d069-4692-4e27-9203-9b6c738a0e03 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] Returning 404 to user: Instance 3b71640b-07ee-4677-8477-21da0a4166b1 could not be found. {{(pid=100593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:39:58.728688 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3715d069-4692-4e27-9203-9b6c738a0e03 tempest-AttachVolumeTestJSON-1906493381 tempest-AttachVolumeTestJSON-1906493381-project] 10.222.0.25 "GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1" status: 404 len: 111 microversion: 2.1 time: 0.070096 Apr 20 18:39:58.729300 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 511/1014] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:39:58 2021] GET /compute/v2.1/servers/3b71640b-07ee-4677-8477-21da0a4166b1 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:39:59.062057 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-8e4942c0-9bb5-4853-b6af-b39e99eccc71 req-95bd1e0f-6d4d-43ba-ab7e-e35650c11286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976", "name": "network-vif-plugged", "status": "completed", "tag": "c57f912b-2b41-47e1-bdd2-e6f469efb49c"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:39:59.063825 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:39:59.063825 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:39:59.075515 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-8e4942c0-9bb5-4853-b6af-b39e99eccc71 req-95bd1e0f-6d4d-43ba-ab7e-e35650c11286 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:59.076509 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-8e4942c0-9bb5-4853-b6af-b39e99eccc71 req-95bd1e0f-6d4d-43ba-ab7e-e35650c11286 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:59.096738 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-8e4942c0-9bb5-4853-b6af-b39e99eccc71 req-95bd1e0f-6d4d-43ba-ab7e-e35650c11286 service nova] Creating event network-vif-plugged:c57f912b-2b41-47e1-bdd2-e6f469efb49c for instance bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 on hv-cinder-78693 Apr 20 18:39:59.103489 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-8e4942c0-9bb5-4853-b6af-b39e99eccc71 req-95bd1e0f-6d4d-43ba-ab7e-e35650c11286 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045504 Apr 20 18:39:59.104381 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 504/1015] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:39:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:39:59.736982 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e069a475-e0b5-4510-9fea-e48c2cb5c94f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:39:59.737689 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e069a475-e0b5-4510-9fea-e48c2cb5c94f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:39:59.745728 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e069a475-e0b5-4510-9fea-e48c2cb5c94f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:59.746240 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e069a475-e0b5-4510-9fea-e48c2cb5c94f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:59.747148 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e069a475-e0b5-4510-9fea-e48c2cb5c94f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:39:59.748279 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e069a475-e0b5-4510-9fea-e48c2cb5c94f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:39:59.978151 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e069a475-e0b5-4510-9fea-e48c2cb5c94f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:59.989471 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e069a475-e0b5-4510-9fea-e48c2cb5c94f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:59.991185 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e069a475-e0b5-4510-9fea-e48c2cb5c94f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:39:59.992437 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e069a475-e0b5-4510-9fea-e48c2cb5c94f tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1731 microversion: 2.20 time: 0.260471 Apr 20 18:39:59.993486 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 512/1016] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:39:59 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1731 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:40:01.015387 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0155f13d-ff7d-45a3-b166-309aecb29807 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:01.016252 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0155f13d-ff7d-45a3-b166-309aecb29807 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:01.027698 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0155f13d-ff7d-45a3-b166-309aecb29807 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:01.028619 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0155f13d-ff7d-45a3-b166-309aecb29807 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:01.030583 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0155f13d-ff7d-45a3-b166-309aecb29807 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:01.031277 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0155f13d-ff7d-45a3-b166-309aecb29807 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:01.464508 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0155f13d-ff7d-45a3-b166-309aecb29807 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:01.484413 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0155f13d-ff7d-45a3-b166-309aecb29807 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:01.486197 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0155f13d-ff7d-45a3-b166-309aecb29807 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:01.487455 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0155f13d-ff7d-45a3-b166-309aecb29807 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1731 microversion: 2.20 time: 0.478784 Apr 20 18:40:01.488093 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 505/1017] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:40:01 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1731 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:40:02.507987 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9f3faacc-e650-4e43-8495-187c9984fcdc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:02.509511 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9f3faacc-e650-4e43-8495-187c9984fcdc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:02.522108 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9f3faacc-e650-4e43-8495-187c9984fcdc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:02.523445 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9f3faacc-e650-4e43-8495-187c9984fcdc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:02.524519 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9f3faacc-e650-4e43-8495-187c9984fcdc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:02.525220 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9f3faacc-e650-4e43-8495-187c9984fcdc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:02.762530 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9f3faacc-e650-4e43-8495-187c9984fcdc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:02.773914 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9f3faacc-e650-4e43-8495-187c9984fcdc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:02.775902 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9f3faacc-e650-4e43-8495-187c9984fcdc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:02.777357 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9f3faacc-e650-4e43-8495-187c9984fcdc tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1718 microversion: 2.20 time: 0.273600 Apr 20 18:40:02.778356 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 513/1018] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:40:02 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1718 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:40:06.379286 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-bb046be4-78c1-42d0-b5de-a1b9657d91fd tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1695079605"}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:06.380557 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-bb046be4-78c1-42d0-b5de-a1b9657d91fd tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:06.389471 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bb046be4-78c1-42d0-b5de-a1b9657d91fd tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:06.390278 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bb046be4-78c1-42d0-b5de-a1b9657d91fd tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:06.391359 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bb046be4-78c1-42d0-b5de-a1b9657d91fd tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:06.392056 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bb046be4-78c1-42d0-b5de-a1b9657d91fd tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:06.623293 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.network.security_group_api [None req-bb046be4-78c1-42d0-b5de-a1b9657d91fd tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Removing security group 062979a9-6a2d-4e09-aa3d-aa99d4897cdf from port d5b99ffe-cbe8-42b3-8e44-5a3598c73540 Apr 20 18:40:07.168608 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-bb046be4-78c1-42d0-b5de-a1b9657d91fd tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "POST /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59/action" status: 202 len: 0 microversion: 2.1 time: 0.793314 Apr 20 18:40:07.170000 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 506/1019] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:40:06 2021] POST /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59/action => generated 0 bytes in 795 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:40:07.186324 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-40ab60bd-9541-46a2-9d6f-0335437e07e1 req-9dd5b6d8-428a-436d-b2b2-a949cf28fa2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fa521e9-06dd-4516-8413-ce388953fe59", "tag": "d5b99ffe-cbe8-42b3-8e44-5a3598c73540"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:07.188661 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:40:07.188661 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:40:07.200098 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-40ab60bd-9541-46a2-9d6f-0335437e07e1 req-9dd5b6d8-428a-436d-b2b2-a949cf28fa2e service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:07.200812 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-40ab60bd-9541-46a2-9d6f-0335437e07e1 req-9dd5b6d8-428a-436d-b2b2-a949cf28fa2e service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:07.237187 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-40ab60bd-9541-46a2-9d6f-0335437e07e1 req-9dd5b6d8-428a-436d-b2b2-a949cf28fa2e service nova] Creating event network-changed:d5b99ffe-cbe8-42b3-8e44-5a3598c73540 for instance 4fa521e9-06dd-4516-8413-ce388953fe59 on hv-cinder-78693 Apr 20 18:40:07.246339 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-40ab60bd-9541-46a2-9d6f-0335437e07e1 req-9dd5b6d8-428a-436d-b2b2-a949cf28fa2e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065423 Apr 20 18:40:07.247103 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 514/1020] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:40:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:08.834591 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c4079c08-3946-41ea-9d67-17136515b3c3 tempest-VolumesTestJSON-1462892367 tempest-VolumesTestJSON-1462892367-project] Calling method '.version_select at 0x7f418e268d08>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:08.938631 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c4079c08-3946-41ea-9d67-17136515b3c3 tempest-VolumesTestJSON-1462892367 tempest-VolumesTestJSON-1462892367-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/c3e06fcc-c804-4fd6-af28-795820b21954" status: 200 len: 350 microversion: 2.1 time: 0.108336 Apr 20 18:40:08.939268 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 507/1021] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Apr 20 18:40:08 2021] GET /compute/v2.1/os-volumes/c3e06fcc-c804-4fd6-af28-795820b21954 => generated 350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:10.162719 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-87989fec-4d8d-498a-9ac1-d051d64f4354 req-02481fab-ef17-4835-b923-deb50b345f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fa521e9-06dd-4516-8413-ce388953fe59", "tag": "d5b99ffe-cbe8-42b3-8e44-5a3598c73540"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:10.164559 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:40:10.164559 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:40:10.170944 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3863c005-dc12-4e2b-8c16-6aecdde2e5d3 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:10.171599 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3863c005-dc12-4e2b-8c16-6aecdde2e5d3 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:10.180026 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3863c005-dc12-4e2b-8c16-6aecdde2e5d3 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:10.180538 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3863c005-dc12-4e2b-8c16-6aecdde2e5d3 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:10.181308 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-87989fec-4d8d-498a-9ac1-d051d64f4354 req-02481fab-ef17-4835-b923-deb50b345f05 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:10.181776 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3863c005-dc12-4e2b-8c16-6aecdde2e5d3 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:10.181887 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-87989fec-4d8d-498a-9ac1-d051d64f4354 req-02481fab-ef17-4835-b923-deb50b345f05 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:10.182276 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3863c005-dc12-4e2b-8c16-6aecdde2e5d3 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:10.199494 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-87989fec-4d8d-498a-9ac1-d051d64f4354 req-02481fab-ef17-4835-b923-deb50b345f05 service nova] Creating event network-changed:d5b99ffe-cbe8-42b3-8e44-5a3598c73540 for instance 4fa521e9-06dd-4516-8413-ce388953fe59 on hv-cinder-78693 Apr 20 18:40:10.205536 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-87989fec-4d8d-498a-9ac1-d051d64f4354 req-02481fab-ef17-4835-b923-deb50b345f05 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046660 Apr 20 18:40:10.206526 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 508/1022] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:40:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:10.386198 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-3863c005-dc12-4e2b-8c16-6aecdde2e5d3 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lazy-loading 'services' on Instance uuid 4fa521e9-06dd-4516-8413-ce388953fe59 {{(pid=100593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:40:10.529336 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-bb133702-1b75-4362-b53c-236e9ec60bf2 tempest-VolumesTestJSON-1462892367 tempest-VolumesTestJSON-1462892367-project] Calling method '.version_select at 0x7f418e268d08>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:10.575287 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3863c005-dc12-4e2b-8c16-6aecdde2e5d3 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59/os-volume_attachments/bc1d7102-18df-4078-88e1-2fbc76baaff5" status: 202 len: 0 microversion: 2.1 time: 0.421599 Apr 20 18:40:10.577327 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 515/1023] 10.222.0.25 () {58 vars in 1406 bytes} [Tue Apr 20 18:40:10 2021] DELETE /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59/os-volume_attachments/bc1d7102-18df-4078-88e1-2fbc76baaff5 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:40:10.604297 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-98321bb5-0856-44b8-b337-8a5adaa7bd4b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:10.606007 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-98321bb5-0856-44b8-b337-8a5adaa7bd4b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:10.617108 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-98321bb5-0856-44b8-b337-8a5adaa7bd4b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:10.617651 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-98321bb5-0856-44b8-b337-8a5adaa7bd4b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:10.618509 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-98321bb5-0856-44b8-b337-8a5adaa7bd4b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:10.619301 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-98321bb5-0856-44b8-b337-8a5adaa7bd4b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:10.652894 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-bb133702-1b75-4362-b53c-236e9ec60bf2 tempest-VolumesTestJSON-1462892367 tempest-VolumesTestJSON-1462892367-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/d8bc3ca1-50a1-4a52-9b77-667d01f8bf67" status: 200 len: 350 microversion: 2.1 time: 0.128430 Apr 20 18:40:10.654342 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 509/1024] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Apr 20 18:40:10 2021] GET /compute/v2.1/os-volumes/d8bc3ca1-50a1-4a52-9b77-667d01f8bf67 => generated 350 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:40:10.697170 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-98321bb5-0856-44b8-b337-8a5adaa7bd4b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101795 Apr 20 18:40:10.698039 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 516/1025] 10.222.0.25 () {58 vars in 1292 bytes} [Tue Apr 20 18:40:10 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:11.387542 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:40:11.388927 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: Tue Apr 20 18:40:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:40:11.710519 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c64a034e-7173-4c39-9df2-10a005710e48 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:11.711699 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c64a034e-7173-4c39-9df2-10a005710e48 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:11.720498 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c64a034e-7173-4c39-9df2-10a005710e48 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:11.721005 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c64a034e-7173-4c39-9df2-10a005710e48 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:11.721894 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c64a034e-7173-4c39-9df2-10a005710e48 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:11.722390 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c64a034e-7173-4c39-9df2-10a005710e48 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:11.796584 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c64a034e-7173-4c39-9df2-10a005710e48 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090179 Apr 20 18:40:11.797224 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 510/1026] 10.222.0.25 () {58 vars in 1292 bytes} [Tue Apr 20 18:40:11 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:12.238157 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-233d8a4e-c22e-4233-8c11-4bd0261839bb tempest-VolumesTestJSON-1462892367 tempest-VolumesTestJSON-1462892367-project] Calling method '.version_select at 0x7f418d924d08>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:12.334965 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-233d8a4e-c22e-4233-8c11-4bd0261839bb tempest-VolumesTestJSON-1462892367 tempest-VolumesTestJSON-1462892367-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/75ba650b-e5ab-4cca-ac6c-ef14fbcdf7bd" status: 200 len: 351 microversion: 2.1 time: 0.100847 Apr 20 18:40:12.335663 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 517/1027] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Apr 20 18:40:12 2021] GET /compute/v2.1/os-volumes/75ba650b-e5ab-4cca-ac6c-ef14fbcdf7bd => generated 351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:12.349618 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9f5c23d8-43f9-4925-a15f-c52faa52ddd0 tempest-VolumesTestJSON-1462892367 tempest-VolumesTestJSON-1462892367-project] Calling method '.version_select at 0x7f418d6fb7b8>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:12.438750 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9f5c23d8-43f9-4925-a15f-c52faa52ddd0 tempest-VolumesTestJSON-1462892367 tempest-VolumesTestJSON-1462892367-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.094385 Apr 20 18:40:12.439403 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 511/1028] 10.222.0.25 () {58 vars in 1124 bytes} [Tue Apr 20 18:40:12 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:12.452369 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e38415d8-9ee8-4383-b3cb-bb274f703117 tempest-VolumesTestJSON-1462892367 tempest-VolumesTestJSON-1462892367-project] Calling method '.version_select at 0x7f418ced7d90>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:12.540855 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e38415d8-9ee8-4383-b3cb-bb274f703117 tempest-VolumesTestJSON-1462892367 tempest-VolumesTestJSON-1462892367-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092511 Apr 20 18:40:12.541536 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 518/1029] 10.222.0.25 () {58 vars in 1139 bytes} [Tue Apr 20 18:40:12 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:12.554574 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-59877b4e-976d-4702-a7d4-c2ad61b8ca15 tempest-VolumesTestJSON-1462892367 tempest-VolumesTestJSON-1462892367-project] Calling method '.version_select at 0x7f418e139158>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:12.645979 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-59877b4e-976d-4702-a7d4-c2ad61b8ca15 tempest-VolumesTestJSON-1462892367 tempest-VolumesTestJSON-1462892367-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.095336 Apr 20 18:40:12.646629 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 512/1030] 10.222.0.25 () {58 vars in 1124 bytes} [Tue Apr 20 18:40:12 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:12.658805 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1ae0933a-b96a-4769-9078-2d668d8bb8b3 tempest-VolumesTestJSON-1462892367 tempest-VolumesTestJSON-1462892367-project] Calling method '.version_select at 0x7f418cd4d7b8>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:12.760007 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1ae0933a-b96a-4769-9078-2d668d8bb8b3 tempest-VolumesTestJSON-1462892367 tempest-VolumesTestJSON-1462892367-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.105231 Apr 20 18:40:12.760775 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 519/1031] 10.222.0.25 () {58 vars in 1157 bytes} [Tue Apr 20 18:40:12 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:12.773223 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c742d547-645d-4498-af3b-84fd9333dff6 tempest-VolumesTestJSON-1462892367 tempest-VolumesTestJSON-1462892367-project] Calling method '.version_select at 0x7f4196fc6378>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:12.810144 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-96b4114e-f3d5-40be-98b5-ab5a8e40ea0c tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:12.811767 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-96b4114e-f3d5-40be-98b5-ab5a8e40ea0c tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:12.819718 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-96b4114e-f3d5-40be-98b5-ab5a8e40ea0c tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:12.820237 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-96b4114e-f3d5-40be-98b5-ab5a8e40ea0c tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:12.821089 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-96b4114e-f3d5-40be-98b5-ab5a8e40ea0c tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:12.821616 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-96b4114e-f3d5-40be-98b5-ab5a8e40ea0c tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:12.870806 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c742d547-645d-4498-af3b-84fd9333dff6 tempest-VolumesTestJSON-1462892367 tempest-VolumesTestJSON-1462892367-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.101402 Apr 20 18:40:12.871800 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 513/1032] 10.222.0.25 () {58 vars in 1160 bytes} [Tue Apr 20 18:40:12 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:12.884830 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-385cd50c-999a-410a-ab0d-13b4f7a27966 tempest-VolumesTestJSON-1462892367 tempest-VolumesTestJSON-1462892367-project] Calling method '.version_select at 0x7f4196fc6c80>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:12.898891 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-96b4114e-f3d5-40be-98b5-ab5a8e40ea0c tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092917 Apr 20 18:40:12.899544 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 520/1033] 10.222.0.25 () {58 vars in 1292 bytes} [Tue Apr 20 18:40:12 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:40:12.910341 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-570e989a-6c64-40eb-94ec-5bd0806c630b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:12.910890 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-570e989a-6c64-40eb-94ec-5bd0806c630b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:12.918800 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-570e989a-6c64-40eb-94ec-5bd0806c630b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:12.920509 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-570e989a-6c64-40eb-94ec-5bd0806c630b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:12.921596 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-570e989a-6c64-40eb-94ec-5bd0806c630b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:12.922094 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-570e989a-6c64-40eb-94ec-5bd0806c630b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:12.978053 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-385cd50c-999a-410a-ab0d-13b4f7a27966 tempest-VolumesTestJSON-1462892367 tempest-VolumesTestJSON-1462892367-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.097481 Apr 20 18:40:12.978804 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 514/1034] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Apr 20 18:40:12 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:40:12.991330 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ff644a39-ef2c-4860-ab75-815aaffdf584 tempest-VolumesTestJSON-1462892367 tempest-VolumesTestJSON-1462892367-project] Calling method '.version_select at 0x7f4192222bf8>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:13.078415 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ff644a39-ef2c-4860-ab75-815aaffdf584 tempest-VolumesTestJSON-1462892367 tempest-VolumesTestJSON-1462892367-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090885 Apr 20 18:40:13.079070 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 515/1035] 10.222.0.25 () {58 vars in 1178 bytes} [Tue Apr 20 18:40:12 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:40:13.091004 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-436f066d-d029-422e-ba40-654a032c6a14 tempest-VolumesTestJSON-1462892367 tempest-VolumesTestJSON-1462892367-project] Calling method '.version_select at 0x7f418d6fb7b8>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:13.093373 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-570e989a-6c64-40eb-94ec-5bd0806c630b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] HTTP exception thrown: Instance 4fa521e9-06dd-4516-8413-ce388953fe59 is not attached to volume bc1d7102-18df-4078-88e1-2fbc76baaff5 Apr 20 18:40:13.094072 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-570e989a-6c64-40eb-94ec-5bd0806c630b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Returning 404 to user: Instance 4fa521e9-06dd-4516-8413-ce388953fe59 is not attached to volume bc1d7102-18df-4078-88e1-2fbc76baaff5 {{(pid=100593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:40:13.094994 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-570e989a-6c64-40eb-94ec-5bd0806c630b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59/os-volume_attachments/bc1d7102-18df-4078-88e1-2fbc76baaff5" status: 404 len: 154 microversion: 2.1 time: 0.188776 Apr 20 18:40:13.095620 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 521/1036] 10.222.0.25 () {58 vars in 1406 bytes} [Tue Apr 20 18:40:12 2021] DELETE /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59/os-volume_attachments/bc1d7102-18df-4078-88e1-2fbc76baaff5 => generated 154 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 18:40:13.179091 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-436f066d-d029-422e-ba40-654a032c6a14 tempest-VolumesTestJSON-1462892367 tempest-VolumesTestJSON-1462892367-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.091835 Apr 20 18:40:13.179746 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 516/1037] 10.222.0.25 () {58 vars in 1145 bytes} [Tue Apr 20 18:40:13 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:40:14.347322 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-69f07f75-876e-4bbd-8679-6824b2d07ad6 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:14.347869 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-69f07f75-876e-4bbd-8679-6824b2d07ad6 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:14.355942 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-69f07f75-876e-4bbd-8679-6824b2d07ad6 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:14.356442 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-69f07f75-876e-4bbd-8679-6824b2d07ad6 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:14.357431 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-69f07f75-876e-4bbd-8679-6824b2d07ad6 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:14.357897 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-69f07f75-876e-4bbd-8679-6824b2d07ad6 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:14.431957 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-69f07f75-876e-4bbd-8679-6824b2d07ad6 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Going to try to terminate instance {{(pid=100593) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:40:14.554261 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-69f07f75-876e-4bbd-8679-6824b2d07ad6 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 204 len: 0 microversion: 2.1 time: 0.210486 Apr 20 18:40:14.554877 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 522/1038] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:40:14 2021] DELETE /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:40:14.564346 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9dd817f5-b663-4986-affc-8e60491cd016 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:14.566117 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9dd817f5-b663-4986-affc-8e60491cd016 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:14.574204 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9dd817f5-b663-4986-affc-8e60491cd016 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:14.574708 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9dd817f5-b663-4986-affc-8e60491cd016 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:14.576242 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9dd817f5-b663-4986-affc-8e60491cd016 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:14.577292 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9dd817f5-b663-4986-affc-8e60491cd016 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:14.818285 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9dd817f5-b663-4986-affc-8e60491cd016 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:14.828156 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9dd817f5-b663-4986-affc-8e60491cd016 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1552 microversion: 2.1 time: 0.268507 Apr 20 18:40:14.828804 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 517/1039] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:14 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1552 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:15.847490 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1f851f66-9983-4e04-bb91-3ea013af1295 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:15.848444 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1f851f66-9983-4e04-bb91-3ea013af1295 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:15.856899 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1f851f66-9983-4e04-bb91-3ea013af1295 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:15.857441 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1f851f66-9983-4e04-bb91-3ea013af1295 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:15.858328 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1f851f66-9983-4e04-bb91-3ea013af1295 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:15.858831 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1f851f66-9983-4e04-bb91-3ea013af1295 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:16.090818 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1f851f66-9983-4e04-bb91-3ea013af1295 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:16.100311 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1f851f66-9983-4e04-bb91-3ea013af1295 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1552 microversion: 2.1 time: 0.257430 Apr 20 18:40:16.100948 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 523/1040] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:15 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1552 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:17.119202 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5ab0c901-e322-4edc-91ed-2c8e320f902b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:17.119882 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5ab0c901-e322-4edc-91ed-2c8e320f902b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:17.128547 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5ab0c901-e322-4edc-91ed-2c8e320f902b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:17.129055 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5ab0c901-e322-4edc-91ed-2c8e320f902b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:17.129942 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5ab0c901-e322-4edc-91ed-2c8e320f902b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:17.130439 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5ab0c901-e322-4edc-91ed-2c8e320f902b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:17.564333 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5ab0c901-e322-4edc-91ed-2c8e320f902b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb4b8a040bad47f4994f810038c18ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e634dce05f2b45d593dfbca5940a886d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:17.573945 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5ab0c901-e322-4edc-91ed-2c8e320f902b tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 200 len: 1552 microversion: 2.1 time: 0.458694 Apr 20 18:40:17.574967 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 518/1041] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:17 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 1552 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:17.721050 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-9b8e7419-db5f-4fa0-9aec-86d6cadc2fc9 req-b0fb3520-af14-4c4d-8be8-10e21eaa186e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fa521e9-06dd-4516-8413-ce388953fe59", "name": "network-vif-deleted", "tag": "d5b99ffe-cbe8-42b3-8e44-5a3598c73540"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:17.724454 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:40:17.724454 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:40:17.735603 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-9b8e7419-db5f-4fa0-9aec-86d6cadc2fc9 req-b0fb3520-af14-4c4d-8be8-10e21eaa186e service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:17.736109 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-9b8e7419-db5f-4fa0-9aec-86d6cadc2fc9 req-b0fb3520-af14-4c4d-8be8-10e21eaa186e service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:17.757078 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-9b8e7419-db5f-4fa0-9aec-86d6cadc2fc9 req-b0fb3520-af14-4c4d-8be8-10e21eaa186e service nova] Creating event network-vif-deleted:d5b99ffe-cbe8-42b3-8e44-5a3598c73540 for instance 4fa521e9-06dd-4516-8413-ce388953fe59 on hv-cinder-78693 Apr 20 18:40:17.762661 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-9b8e7419-db5f-4fa0-9aec-86d6cadc2fc9 req-b0fb3520-af14-4c4d-8be8-10e21eaa186e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046643 Apr 20 18:40:17.764340 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 524/1042] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:40:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:18.593448 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8bc24ebc-3311-44ae-a5db-63d3fcf541b3 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:18.594375 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8bc24ebc-3311-44ae-a5db-63d3fcf541b3 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] [instance: 4fa521e9-06dd-4516-8413-ce388953fe59] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:18.599647 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ab8a5762-afa1-420e-a3f1-003bafc17f0e tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] Action: 'create', calling method: .version_select at 0x7f418d8fbae8>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1669896771", "metadata": {"Type": "work"}}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:18.602333 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ab8a5762-afa1-420e-a3f1-003bafc17f0e tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:40:18.603428 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ab8a5762-afa1-420e-a3f1-003bafc17f0e tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.132577 Apr 20 18:40:18.604301 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 519/1043] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Apr 20 18:40:18 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:40:18.604955 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8bc24ebc-3311-44ae-a5db-63d3fcf541b3 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:18.605597 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8bc24ebc-3311-44ae-a5db-63d3fcf541b3 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:18.606589 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8bc24ebc-3311-44ae-a5db-63d3fcf541b3 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:18.607689 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8bc24ebc-3311-44ae-a5db-63d3fcf541b3 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:18.615604 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-92998698-88bb-41f5-a7ea-d4289fa930c5 tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] Action: 'create', calling method: .version_select at 0x7f418e1540d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1949638441", "metadata": {"Type": "work"}}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:18.616867 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-92998698-88bb-41f5-a7ea-d4289fa930c5 tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:40:18.617788 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-92998698-88bb-41f5-a7ea-d4289fa930c5 tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006371 Apr 20 18:40:18.618386 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 520/1044] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Apr 20 18:40:18 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 20 18:40:18.629047 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-40d1848a-724c-4306-bca8-8c5a83f010e0 tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] Action: 'create', calling method: .version_select at 0x7f4196fc6620>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-549385968", "metadata": {"Type": "work"}}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:18.630327 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-40d1848a-724c-4306-bca8-8c5a83f010e0 tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:40:18.631182 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-40d1848a-724c-4306-bca8-8c5a83f010e0 tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006032 Apr 20 18:40:18.631898 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 521/1045] 10.222.0.25 () {60 vars in 1146 bytes} [Tue Apr 20 18:40:18 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:40:18.640951 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a9ef2c73-3672-4175-a4bc-9dd607ec2028 tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] Calling method '.version_select at 0x7f418eb1ad90>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:18.661259 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-8bc24ebc-3311-44ae-a5db-63d3fcf541b3 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] HTTP exception thrown: Instance 4fa521e9-06dd-4516-8413-ce388953fe59 could not be found. Apr 20 18:40:18.661967 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8bc24ebc-3311-44ae-a5db-63d3fcf541b3 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Returning 404 to user: Instance 4fa521e9-06dd-4516-8413-ce388953fe59 could not be found. {{(pid=100593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:40:18.662877 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8bc24ebc-3311-44ae-a5db-63d3fcf541b3 tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59" status: 404 len: 111 microversion: 2.1 time: 0.074416 Apr 20 18:40:18.663511 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 525/1046] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:18 2021] GET /compute/v2.1/servers/4fa521e9-06dd-4516-8413-ce388953fe59 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:40:18.672466 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0c282aca-d0c6-49c6-a7ff-9c8f870905db tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] Calling method '.version_select at 0x7f418d9240d0>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:18.695006 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0c282aca-d0c6-49c6-a7ff-9c8f870905db tempest-TestMinimumBasicScenario-499149077 tempest-TestMinimumBasicScenario-499149077-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-709334130" status: 202 len: 0 microversion: 2.1 time: 0.026793 Apr 20 18:40:18.695659 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 526/1047] 10.222.0.25 () {58 vars in 1259 bytes} [Tue Apr 20 18:40:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-709334130 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 20 18:40:18.712827 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-a9ef2c73-3672-4175-a4bc-9dd607ec2028 tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] HTTP exception thrown: Volume tempest-invalid-780297996 could not be found. Apr 20 18:40:18.713627 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a9ef2c73-3672-4175-a4bc-9dd607ec2028 tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] Returning 404 to user: Volume tempest-invalid-780297996 could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:40:18.714541 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a9ef2c73-3672-4175-a4bc-9dd607ec2028 tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-780297996" status: 404 len: 98 microversion: 2.1 time: 0.077513 Apr 20 18:40:18.715231 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 522/1048] 10.222.0.25 () {58 vars in 1205 bytes} [Tue Apr 20 18:40:18 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-780297996 => generated 98 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 20 18:40:18.725826 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-db748e98-01ea-44ad-9178-3d7daac11b63 tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004012 Apr 20 18:40:18.726959 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 527/1049] 10.222.0.25 () {58 vars in 1130 bytes} [Tue Apr 20 18:40:18 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 20 18:40:18.738082 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4415d06d-4671-40d8-99bd-7aa982958ac5 tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004774 Apr 20 18:40:18.738677 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 523/1050] 10.222.0.25 () {58 vars in 1127 bytes} [Tue Apr 20 18:40:18 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 20 18:40:18.749338 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-becafdcb-c742-4d09-9e53-1a3c6d4c26c9 tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] Calling method '.version_select at 0x7f418cd4d0d0>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:18.819035 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-becafdcb-c742-4d09-9e53-1a3c6d4c26c9 tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] HTTP exception thrown: Volume 76e9ccb5-5049-4102-a111-5b7275bed86a could not be found. Apr 20 18:40:18.819816 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-becafdcb-c742-4d09-9e53-1a3c6d4c26c9 tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] Returning 404 to user: Volume 76e9ccb5-5049-4102-a111-5b7275bed86a could not be found. {{(pid=100593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:40:18.820860 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-becafdcb-c742-4d09-9e53-1a3c6d4c26c9 tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/76e9ccb5-5049-4102-a111-5b7275bed86a" status: 404 len: 109 microversion: 2.1 time: 0.075834 Apr 20 18:40:18.821608 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 528/1051] 10.222.0.25 () {58 vars in 1238 bytes} [Tue Apr 20 18:40:18 2021] DELETE /compute/v2.1/os-volumes/76e9ccb5-5049-4102-a111-5b7275bed86a => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:40:18.831816 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ed882306-f574-42d5-bbe6-316a29ab118f tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] Calling method '.version_select at 0x7f418f290c80>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:18.900888 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-ed882306-f574-42d5-bbe6-316a29ab118f tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] HTTP exception thrown: Volume 391a0c15-f99f-4a8b-99cc-327088095910 could not be found. Apr 20 18:40:18.901606 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ed882306-f574-42d5-bbe6-316a29ab118f tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] Returning 404 to user: Volume 391a0c15-f99f-4a8b-99cc-327088095910 could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:40:18.902532 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ed882306-f574-42d5-bbe6-316a29ab118f tempest-VolumesNegativeTest-417754802 tempest-VolumesNegativeTest-417754802-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/391a0c15-f99f-4a8b-99cc-327088095910" status: 404 len: 109 microversion: 2.1 time: 0.074815 Apr 20 18:40:18.903144 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 524/1052] 10.222.0.25 () {58 vars in 1235 bytes} [Tue Apr 20 18:40:18 2021] GET /compute/v2.1/os-volumes/391a0c15-f99f-4a8b-99cc-327088095910 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:40:35.930006 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4d352661-b2e8-4605-a9c8-699e1719bfa2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:35.930716 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4d352661-b2e8-4605-a9c8-699e1719bfa2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:35.939392 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4d352661-b2e8-4605-a9c8-699e1719bfa2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:35.939879 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4d352661-b2e8-4605-a9c8-699e1719bfa2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:35.940980 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4d352661-b2e8-4605-a9c8-699e1719bfa2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:35.941452 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4d352661-b2e8-4605-a9c8-699e1719bfa2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:36.018859 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4d352661-b2e8-4605-a9c8-699e1719bfa2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Going to try to terminate instance {{(pid=100593) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:40:36.173298 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4d352661-b2e8-4605-a9c8-699e1719bfa2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 204 len: 0 microversion: 2.20 time: 0.248177 Apr 20 18:40:36.174350 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 529/1053] 10.222.0.25 () {60 vars in 1270 bytes} [Tue Apr 20 18:40:35 2021] DELETE /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 20 18:40:36.187716 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1e921f7c-196b-4db9-94cc-d002b6f303d8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:36.188480 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1e921f7c-196b-4db9-94cc-d002b6f303d8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:36.197906 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1e921f7c-196b-4db9-94cc-d002b6f303d8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:36.198417 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1e921f7c-196b-4db9-94cc-d002b6f303d8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:36.199282 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1e921f7c-196b-4db9-94cc-d002b6f303d8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:36.199786 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1e921f7c-196b-4db9-94cc-d002b6f303d8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:36.662491 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1e921f7c-196b-4db9-94cc-d002b6f303d8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:36.676701 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1e921f7c-196b-4db9-94cc-d002b6f303d8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:36.678606 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1e921f7c-196b-4db9-94cc-d002b6f303d8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:36.679948 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1e921f7c-196b-4db9-94cc-d002b6f303d8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1724 microversion: 2.20 time: 0.498358 Apr 20 18:40:36.680832 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 525/1054] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:40:36 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1724 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:40:37.390781 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-be17f136-f201-442d-b37f-b4485b9c3beb tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:37.392163 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-be17f136-f201-442d-b37f-b4485b9c3beb tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:37.413246 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-be17f136-f201-442d-b37f-b4485b9c3beb tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:37.413811 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-be17f136-f201-442d-b37f-b4485b9c3beb tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:37.414926 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-be17f136-f201-442d-b37f-b4485b9c3beb tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:37.415659 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-be17f136-f201-442d-b37f-b4485b9c3beb tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:37.511180 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-be17f136-f201-442d-b37f-b4485b9c3beb tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Going to try to terminate instance {{(pid=100593) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:40:37.659168 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-be17f136-f201-442d-b37f-b4485b9c3beb tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 204 len: 0 microversion: 2.1 time: 0.285568 Apr 20 18:40:37.659830 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 530/1055] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:40:37 2021] DELETE /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:40:37.676692 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-57b1bae8-f4f0-4d8d-ac62-1535af105f45 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:37.688199 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-57b1bae8-f4f0-4d8d-ac62-1535af105f45 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:37.704180 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-57b1bae8-f4f0-4d8d-ac62-1535af105f45 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:37.704180 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-57b1bae8-f4f0-4d8d-ac62-1535af105f45 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:37.704180 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-57b1bae8-f4f0-4d8d-ac62-1535af105f45 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:37.704180 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-57b1bae8-f4f0-4d8d-ac62-1535af105f45 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:37.704597 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-99701e31-cc27-4264-a5b9-cb7324a3d6b8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:37.704597 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-99701e31-cc27-4264-a5b9-cb7324a3d6b8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:37.719280 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-99701e31-cc27-4264-a5b9-cb7324a3d6b8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:37.719898 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-99701e31-cc27-4264-a5b9-cb7324a3d6b8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:37.721268 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-99701e31-cc27-4264-a5b9-cb7324a3d6b8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:37.721893 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-99701e31-cc27-4264-a5b9-cb7324a3d6b8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:38.015389 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-99701e31-cc27-4264-a5b9-cb7324a3d6b8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:38.036995 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-99701e31-cc27-4264-a5b9-cb7324a3d6b8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:38.038807 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-99701e31-cc27-4264-a5b9-cb7324a3d6b8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:38.040114 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-99701e31-cc27-4264-a5b9-cb7324a3d6b8 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1724 microversion: 2.20 time: 0.343537 Apr 20 18:40:38.041052 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 531/1056] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:40:37 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1724 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:40:38.515697 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-57b1bae8-f4f0-4d8d-ac62-1535af105f45 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:38.532293 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-57b1bae8-f4f0-4d8d-ac62-1535af105f45 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 200 len: 1579 microversion: 2.1 time: 0.865401 Apr 20 18:40:38.533265 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 526/1057] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:37 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 1579 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:39.066783 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-168ce609-1118-48a0-9db8-7545871b30e0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:39.066783 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-168ce609-1118-48a0-9db8-7545871b30e0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:39.075301 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-168ce609-1118-48a0-9db8-7545871b30e0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:39.076461 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-168ce609-1118-48a0-9db8-7545871b30e0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:39.077589 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-168ce609-1118-48a0-9db8-7545871b30e0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:39.078177 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-168ce609-1118-48a0-9db8-7545871b30e0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:39.385570 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-168ce609-1118-48a0-9db8-7545871b30e0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:39.404362 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-168ce609-1118-48a0-9db8-7545871b30e0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:39.406867 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-168ce609-1118-48a0-9db8-7545871b30e0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:39.408701 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-168ce609-1118-48a0-9db8-7545871b30e0 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1724 microversion: 2.20 time: 0.347366 Apr 20 18:40:39.409558 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 532/1058] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:40:39 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1724 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:40:39.553431 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-330d9a7a-35ab-498f-977f-b9e7abaf251a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:39.555268 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-330d9a7a-35ab-498f-977f-b9e7abaf251a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:39.567209 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-330d9a7a-35ab-498f-977f-b9e7abaf251a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:39.568536 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-330d9a7a-35ab-498f-977f-b9e7abaf251a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:39.575848 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-330d9a7a-35ab-498f-977f-b9e7abaf251a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:39.576381 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-330d9a7a-35ab-498f-977f-b9e7abaf251a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:40.440962 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3c20b6b1-aeac-4176-a636-034481ce40ba tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:40.441965 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3c20b6b1-aeac-4176-a636-034481ce40ba tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:40.451648 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c20b6b1-aeac-4176-a636-034481ce40ba tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:40.452462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c20b6b1-aeac-4176-a636-034481ce40ba tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:40.453829 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c20b6b1-aeac-4176-a636-034481ce40ba tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:40.454906 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c20b6b1-aeac-4176-a636-034481ce40ba tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:40.715976 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-330d9a7a-35ab-498f-977f-b9e7abaf251a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:40.739971 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-330d9a7a-35ab-498f-977f-b9e7abaf251a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 200 len: 1579 microversion: 2.1 time: 1.189209 Apr 20 18:40:40.748828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 527/1059] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:39 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 1579 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:41.294266 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3c20b6b1-aeac-4176-a636-034481ce40ba tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:41.305642 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3c20b6b1-aeac-4176-a636-034481ce40ba tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:41.307826 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3c20b6b1-aeac-4176-a636-034481ce40ba tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:41.310002 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3c20b6b1-aeac-4176-a636-034481ce40ba tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1724 microversion: 2.20 time: 0.872797 Apr 20 18:40:41.311022 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 533/1060] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:40:40 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1724 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:40:41.767987 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-098d3614-f765-470e-bf34-dacd4c85c287 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:41.770359 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-098d3614-f765-470e-bf34-dacd4c85c287 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:41.791109 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-098d3614-f765-470e-bf34-dacd4c85c287 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:41.791966 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-098d3614-f765-470e-bf34-dacd4c85c287 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:41.795192 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-098d3614-f765-470e-bf34-dacd4c85c287 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:41.796176 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-098d3614-f765-470e-bf34-dacd4c85c287 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:42.139767 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-098d3614-f765-470e-bf34-dacd4c85c287 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:42.158409 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-098d3614-f765-470e-bf34-dacd4c85c287 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 200 len: 1511 microversion: 2.1 time: 0.402061 Apr 20 18:40:42.162704 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 528/1061] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:41 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 1511 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:42.277211 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-af65aad7-6cd9-45d8-962d-751ca3b4a018 req-ae915881-04ce-4dc7-b115-fa8fdca82664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e41ddc-6fad-4179-8d1b-55e8bc4044c8", "name": "network-vif-deleted", "tag": "4fda7bf6-0fcd-4ef5-b14d-d4ef76e12de0"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:42.279681 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:40:42.279681 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:40:42.298682 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-af65aad7-6cd9-45d8-962d-751ca3b4a018 req-ae915881-04ce-4dc7-b115-fa8fdca82664 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:42.299203 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-af65aad7-6cd9-45d8-962d-751ca3b4a018 req-ae915881-04ce-4dc7-b115-fa8fdca82664 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:42.332300 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-766ef8f1-b83f-4fc2-8a92-3ed273eb9836 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:42.333004 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-766ef8f1-b83f-4fc2-8a92-3ed273eb9836 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:42.338362 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-af65aad7-6cd9-45d8-962d-751ca3b4a018 req-ae915881-04ce-4dc7-b115-fa8fdca82664 service nova] Creating event network-vif-deleted:4fda7bf6-0fcd-4ef5-b14d-d4ef76e12de0 for instance f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 on hv-cinder-78693 Apr 20 18:40:42.352453 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-766ef8f1-b83f-4fc2-8a92-3ed273eb9836 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:42.353006 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-766ef8f1-b83f-4fc2-8a92-3ed273eb9836 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:42.355823 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-af65aad7-6cd9-45d8-962d-751ca3b4a018 req-ae915881-04ce-4dc7-b115-fa8fdca82664 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082922 Apr 20 18:40:42.357075 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 534/1062] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:40:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:42.359854 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-766ef8f1-b83f-4fc2-8a92-3ed273eb9836 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:42.360457 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-766ef8f1-b83f-4fc2-8a92-3ed273eb9836 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:42.817339 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-f6f34368-8e23-4c74-9eff-f35f10ed4a68 req-7add2d18-191b-4187-8604-4e06e77ad010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976", "name": "network-vif-deleted", "tag": "c57f912b-2b41-47e1-bdd2-e6f469efb49c"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:42.819125 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:40:42.819125 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:40:42.846807 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-f6f34368-8e23-4c74-9eff-f35f10ed4a68 req-7add2d18-191b-4187-8604-4e06e77ad010 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:42.847996 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-f6f34368-8e23-4c74-9eff-f35f10ed4a68 req-7add2d18-191b-4187-8604-4e06e77ad010 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:42.884193 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-f6f34368-8e23-4c74-9eff-f35f10ed4a68 req-7add2d18-191b-4187-8604-4e06e77ad010 service nova] Creating event network-vif-deleted:c57f912b-2b41-47e1-bdd2-e6f469efb49c for instance bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 on hv-cinder-78693 Apr 20 18:40:42.898068 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-f6f34368-8e23-4c74-9eff-f35f10ed4a68 req-7add2d18-191b-4187-8604-4e06e77ad010 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084986 Apr 20 18:40:42.899027 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 535/1063] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:40:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:40:42.993747 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-766ef8f1-b83f-4fc2-8a92-3ed273eb9836 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:43.022194 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-766ef8f1-b83f-4fc2-8a92-3ed273eb9836 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:43.026925 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-766ef8f1-b83f-4fc2-8a92-3ed273eb9836 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6bc02f4b196a44a5abb1843ae0b099bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39f3f26f55524d2d89d7c9cd7f9548f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:43.031402 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-766ef8f1-b83f-4fc2-8a92-3ed273eb9836 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 200 len: 1656 microversion: 2.20 time: 0.702820 Apr 20 18:40:43.033172 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 529/1064] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:40:42 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 1656 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 18:40:43.197472 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-bea33b33-aede-4467-8521-6b04e434c791 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:43.198959 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-bea33b33-aede-4467-8521-6b04e434c791 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:43.219663 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bea33b33-aede-4467-8521-6b04e434c791 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:43.220406 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bea33b33-aede-4467-8521-6b04e434c791 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:43.221628 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bea33b33-aede-4467-8521-6b04e434c791 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:43.222909 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bea33b33-aede-4467-8521-6b04e434c791 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:43.340356 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bea33b33-aede-4467-8521-6b04e434c791 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:43.341244 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bea33b33-aede-4467-8521-6b04e434c791 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:43.342021 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-bea33b33-aede-4467-8521-6b04e434c791 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lazy-loading 'fault' on Instance uuid f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 {{(pid=100593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:40:43.532151 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-bea33b33-aede-4467-8521-6b04e434c791 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:43.548026 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-bea33b33-aede-4467-8521-6b04e434c791 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 200 len: 1231 microversion: 2.1 time: 0.354382 Apr 20 18:40:43.553539 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 536/1065] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:43 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 1231 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:44.054833 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a573be1e-7ebf-49a9-942a-92e4be3a33c7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:44.055670 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a573be1e-7ebf-49a9-942a-92e4be3a33c7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:44.070238 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a573be1e-7ebf-49a9-942a-92e4be3a33c7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:44.070755 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a573be1e-7ebf-49a9-942a-92e4be3a33c7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:44.071621 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a573be1e-7ebf-49a9-942a-92e4be3a33c7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:44.078966 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a573be1e-7ebf-49a9-942a-92e4be3a33c7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:44.275466 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-a573be1e-7ebf-49a9-942a-92e4be3a33c7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] HTTP exception thrown: Instance bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 could not be found. Apr 20 18:40:44.286927 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a573be1e-7ebf-49a9-942a-92e4be3a33c7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Returning 404 to user: Instance bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:40:44.288061 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a573be1e-7ebf-49a9-942a-92e4be3a33c7 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 404 len: 111 microversion: 2.20 time: 0.238184 Apr 20 18:40:44.289188 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 530/1066] 10.222.0.25 () {60 vars in 1267 bytes} [Tue Apr 20 18:40:44 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 111 bytes in 240 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:40:44.301152 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7561ff06-f3ca-4cc4-8fdc-24f77194829a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '.version_select at 0x7f418d0d7510>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:44.336831 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7561ff06-f3ca-4cc4-8fdc-24f77194829a tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-284959789" status: 204 len: 0 microversion: 2.20 time: 0.040684 Apr 20 18:40:44.338197 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 537/1067] 10.222.0.25 () {60 vars in 1249 bytes} [Tue Apr 20 18:40:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-284959789 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 18:40:44.579228 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9a30591f-e57e-4fff-8f69-c8e888b3ed46 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:44.580075 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9a30591f-e57e-4fff-8f69-c8e888b3ed46 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:44.599038 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9a30591f-e57e-4fff-8f69-c8e888b3ed46 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:44.599909 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9a30591f-e57e-4fff-8f69-c8e888b3ed46 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:44.601267 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9a30591f-e57e-4fff-8f69-c8e888b3ed46 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:44.604864 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9a30591f-e57e-4fff-8f69-c8e888b3ed46 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:44.769950 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-9a30591f-e57e-4fff-8f69-c8e888b3ed46 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] HTTP exception thrown: Instance f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 could not be found. Apr 20 18:40:44.773708 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9a30591f-e57e-4fff-8f69-c8e888b3ed46 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Returning 404 to user: Instance f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:40:44.777269 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9a30591f-e57e-4fff-8f69-c8e888b3ed46 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 404 len: 111 microversion: 2.1 time: 0.203519 Apr 20 18:40:44.781170 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 531/1068] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:44 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 111 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:40:45.233706 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-929c43a7-b229-40ee-96ad-025e2f8eb0d6 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1895663055", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1782040926", "security_groups": [{"name": "tempest-secgroup-smoke-1408344531"}], "block_device_mapping_v2": [{"uuid": "68e5c09c-f2f6-4267-b9fd-3edafdf2b0df", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8bd2d403-a674-4166-b6a7-876b78a5d8d4"}]}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:45.968282 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.network.neutron [None req-929c43a7-b229-40ee-96ad-025e2f8eb0d6 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] validate_networks() for [('8bd2d403-a674-4166-b6a7-876b78a5d8d4', None, None, None)] {{(pid=100593) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:40:47.453517 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-929c43a7-b229-40ee-96ad-025e2f8eb0d6 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Flavor limits 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:40:47.454407 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-929c43a7-b229-40ee-96ad-025e2f8eb0d6 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Image limits 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:40:47.454978 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-929c43a7-b229-40ee-96ad-025e2f8eb0d6 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Flavor pref 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:40:47.455445 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-929c43a7-b229-40ee-96ad-025e2f8eb0d6 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Image pref 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:40:47.455921 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-929c43a7-b229-40ee-96ad-025e2f8eb0d6 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:40:47.468207 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-929c43a7-b229-40ee-96ad-025e2f8eb0d6 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:47.468980 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-929c43a7-b229-40ee-96ad-025e2f8eb0d6 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:47.470105 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-929c43a7-b229-40ee-96ad-025e2f8eb0d6 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:47.470776 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-929c43a7-b229-40ee-96ad-025e2f8eb0d6 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:47.494398 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-929c43a7-b229-40ee-96ad-025e2f8eb0d6 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Getting quotas for project d38b0824b83f40c9874ffbc291951949. Resources: {'instances', 'ram', 'cores'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:40:47.500658 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-929c43a7-b229-40ee-96ad-025e2f8eb0d6 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Getting quotas for user 7a04013dbac84c5f93bdb7946e50d21d and project d38b0824b83f40c9874ffbc291951949. Resources: {'instances', 'ram', 'cores'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:40:47.709550 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-929c43a7-b229-40ee-96ad-025e2f8eb0d6 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Going to run 1 instances... {{(pid=100593) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:40:47.712505 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-929c43a7-b229-40ee-96ad-025e2f8eb0d6 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68e5c09c-f2f6-4267-b9fd-3edafdf2b0df',volume_size=None,volume_type=None)] {{(pid=100593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:40:48.047758 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-929c43a7-b229-40ee-96ad-025e2f8eb0d6 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.822598 Apr 20 18:40:48.057199 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 538/1069] 10.222.0.25 () {60 vars in 1137 bytes} [Tue Apr 20 18:40:45 2021] POST /compute/v2.1/servers => generated 406 bytes in 2827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:40:48.088601 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-dfca24e9-8ed0-4de3-a73c-ace522e3f697 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:48.093150 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-dfca24e9-8ed0-4de3-a73c-ace522e3f697 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:48.279592 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-dfca24e9-8ed0-4de3-a73c-ace522e3f697 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:48.301877 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-dfca24e9-8ed0-4de3-a73c-ace522e3f697 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e" status: 200 len: 1095 microversion: 2.1 time: 0.242815 Apr 20 18:40:48.307864 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 532/1070] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:48 2021] GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e => generated 1095 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:49.341703 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5a2ba31c-8288-4726-b86e-d5cd02367c72 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:49.342835 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5a2ba31c-8288-4726-b86e-d5cd02367c72 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:49.357998 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a2ba31c-8288-4726-b86e-d5cd02367c72 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:49.358723 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a2ba31c-8288-4726-b86e-d5cd02367c72 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:49.359775 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a2ba31c-8288-4726-b86e-d5cd02367c72 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:49.360649 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5a2ba31c-8288-4726-b86e-d5cd02367c72 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:49.635560 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5a2ba31c-8288-4726-b86e-d5cd02367c72 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:49.672697 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5a2ba31c-8288-4726-b86e-d5cd02367c72 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e" status: 200 len: 1193 microversion: 2.1 time: 0.338948 Apr 20 18:40:49.673852 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 539/1071] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:49 2021] GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e => generated 1193 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:50.300536 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-cf97c264-c9d0-462c-9c76-66c9e07fc5c2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:50.303931 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-cf97c264-c9d0-462c-9c76-66c9e07fc5c2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:50.318807 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cf97c264-c9d0-462c-9c76-66c9e07fc5c2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:50.319483 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cf97c264-c9d0-462c-9c76-66c9e07fc5c2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:50.320514 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cf97c264-c9d0-462c-9c76-66c9e07fc5c2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:50.321636 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cf97c264-c9d0-462c-9c76-66c9e07fc5c2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:50.404658 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-cf97c264-c9d0-462c-9c76-66c9e07fc5c2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] HTTP exception thrown: Instance bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 could not be found. Apr 20 18:40:50.406055 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-cf97c264-c9d0-462c-9c76-66c9e07fc5c2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Returning 404 to user: Instance bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:40:50.407222 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-cf97c264-c9d0-462c-9c76-66c9e07fc5c2 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "DELETE /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 404 len: 111 microversion: 2.1 time: 0.111349 Apr 20 18:40:50.408262 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 533/1072] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:40:50 2021] DELETE /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:40:50.426290 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b66be1f4-0dba-4104-a938-592d6c48a38d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:50.429100 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b66be1f4-0dba-4104-a938-592d6c48a38d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:50.441228 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b66be1f4-0dba-4104-a938-592d6c48a38d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:50.441772 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b66be1f4-0dba-4104-a938-592d6c48a38d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:50.442642 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b66be1f4-0dba-4104-a938-592d6c48a38d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:50.443140 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b66be1f4-0dba-4104-a938-592d6c48a38d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:50.532219 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-b66be1f4-0dba-4104-a938-592d6c48a38d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] HTTP exception thrown: Instance bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 could not be found. Apr 20 18:40:50.533599 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b66be1f4-0dba-4104-a938-592d6c48a38d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Returning 404 to user: Instance bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 could not be found. {{(pid=100593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:40:50.536990 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b66be1f4-0dba-4104-a938-592d6c48a38d tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976" status: 404 len: 111 microversion: 2.1 time: 0.119362 Apr 20 18:40:50.538460 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 540/1073] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:50 2021] GET /compute/v2.1/servers/bf034ef4-b3fc-4fd4-b06a-eafd8f1d5976 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:40:50.700896 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1dd9f3b1-6c39-4a18-a3a4-40785284a786 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:50.707503 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1dd9f3b1-6c39-4a18-a3a4-40785284a786 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:50.738129 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1dd9f3b1-6c39-4a18-a3a4-40785284a786 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:50.738661 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1dd9f3b1-6c39-4a18-a3a4-40785284a786 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:50.739532 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1dd9f3b1-6c39-4a18-a3a4-40785284a786 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:50.742461 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1dd9f3b1-6c39-4a18-a3a4-40785284a786 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:50.987919 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1dd9f3b1-6c39-4a18-a3a4-40785284a786 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:51.002548 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1dd9f3b1-6c39-4a18-a3a4-40785284a786 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e" status: 200 len: 1211 microversion: 2.1 time: 0.314095 Apr 20 18:40:51.003482 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 534/1074] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:50 2021] GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e => generated 1211 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:52.039544 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b946f152-35d5-4961-b02e-626c8dd93914 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:52.048814 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b946f152-35d5-4961-b02e-626c8dd93914 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:52.097380 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b946f152-35d5-4961-b02e-626c8dd93914 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:52.099911 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b946f152-35d5-4961-b02e-626c8dd93914 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:52.101745 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b946f152-35d5-4961-b02e-626c8dd93914 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:52.102659 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b946f152-35d5-4961-b02e-626c8dd93914 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:52.396090 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-fb965b5f-8978-414b-a92c-6b17d529c2a9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:52.397119 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-fb965b5f-8978-414b-a92c-6b17d529c2a9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:52.442587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fb965b5f-8978-414b-a92c-6b17d529c2a9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:52.445697 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fb965b5f-8978-414b-a92c-6b17d529c2a9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:52.448064 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fb965b5f-8978-414b-a92c-6b17d529c2a9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:52.449222 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fb965b5f-8978-414b-a92c-6b17d529c2a9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:52.656715 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-fb965b5f-8978-414b-a92c-6b17d529c2a9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] HTTP exception thrown: Instance 1e532f85-bed6-43d3-969d-3a2688b4638b could not be found. Apr 20 18:40:52.662599 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-fb965b5f-8978-414b-a92c-6b17d529c2a9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Returning 404 to user: Instance 1e532f85-bed6-43d3-969d-3a2688b4638b could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:40:52.665035 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-fb965b5f-8978-414b-a92c-6b17d529c2a9 tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 404 len: 111 microversion: 2.1 time: 0.284966 Apr 20 18:40:52.666606 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 535/1075] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:40:52 2021] DELETE /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 111 bytes in 288 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:40:52.680294 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3a6d11ea-9bfc-4c07-b395-e4a41f92ca6c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:52.697709 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3a6d11ea-9bfc-4c07-b395-e4a41f92ca6c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] [instance: 1e532f85-bed6-43d3-969d-3a2688b4638b] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:52.723786 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3a6d11ea-9bfc-4c07-b395-e4a41f92ca6c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:52.724224 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3a6d11ea-9bfc-4c07-b395-e4a41f92ca6c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:52.725154 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3a6d11ea-9bfc-4c07-b395-e4a41f92ca6c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:52.725991 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3a6d11ea-9bfc-4c07-b395-e4a41f92ca6c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:52.796992 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-3a6d11ea-9bfc-4c07-b395-e4a41f92ca6c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] HTTP exception thrown: Instance 1e532f85-bed6-43d3-969d-3a2688b4638b could not be found. Apr 20 18:40:52.797639 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3a6d11ea-9bfc-4c07-b395-e4a41f92ca6c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] Returning 404 to user: Instance 1e532f85-bed6-43d3-969d-3a2688b4638b could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:40:52.798578 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3a6d11ea-9bfc-4c07-b395-e4a41f92ca6c tempest-AttachVolumeShelveTestJSON-1378624936 tempest-AttachVolumeShelveTestJSON-1378624936-project] 10.222.0.25 "GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b" status: 404 len: 111 microversion: 2.1 time: 0.126590 Apr 20 18:40:52.802895 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b946f152-35d5-4961-b02e-626c8dd93914 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:52.803535 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 536/1076] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:52 2021] GET /compute/v2.1/servers/1e532f85-bed6-43d3-969d-3a2688b4638b => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:40:52.813822 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b946f152-35d5-4961-b02e-626c8dd93914 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e" status: 200 len: 1267 microversion: 2.1 time: 0.782022 Apr 20 18:40:52.815117 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 541/1077] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:52 2021] GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e => generated 1267 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:53.089657 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-9f5db1ee-660f-4e5c-a942-110db6c04bf7 req-014a95a4-360b-4d48-8fb6-dcae39310e7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e", "tag": "3f62a456-a3af-4478-ac42-4fa222c97208"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:53.091972 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:40:53.091972 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:40:53.110617 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-9f5db1ee-660f-4e5c-a942-110db6c04bf7 req-014a95a4-360b-4d48-8fb6-dcae39310e7b service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:53.111105 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-9f5db1ee-660f-4e5c-a942-110db6c04bf7 req-014a95a4-360b-4d48-8fb6-dcae39310e7b service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:53.157182 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-9f5db1ee-660f-4e5c-a942-110db6c04bf7 req-014a95a4-360b-4d48-8fb6-dcae39310e7b service nova] Creating event network-changed:3f62a456-a3af-4478-ac42-4fa222c97208 for instance 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e on hv-cinder-78693 Apr 20 18:40:53.165486 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-9f5db1ee-660f-4e5c-a942-110db6c04bf7 req-014a95a4-360b-4d48-8fb6-dcae39310e7b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079283 Apr 20 18:40:53.166697 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 537/1078] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:40:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:53.844268 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-36fe0966-0a37-48fb-878b-24b542ef3e0c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:53.844974 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-36fe0966-0a37-48fb-878b-24b542ef3e0c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:53.857276 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-36fe0966-0a37-48fb-878b-24b542ef3e0c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:53.858167 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-36fe0966-0a37-48fb-878b-24b542ef3e0c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:53.859290 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-36fe0966-0a37-48fb-878b-24b542ef3e0c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:53.860219 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-36fe0966-0a37-48fb-878b-24b542ef3e0c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:55.017079 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-36fe0966-0a37-48fb-878b-24b542ef3e0c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:55.039445 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-36fe0966-0a37-48fb-878b-24b542ef3e0c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e" status: 200 len: 1267 microversion: 2.1 time: 1.209220 Apr 20 18:40:55.041691 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 542/1079] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:53 2021] GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e => generated 1267 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:56.082360 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d5384b55-d7ba-4e65-b26b-5bcbdf71f86e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:56.083252 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d5384b55-d7ba-4e65-b26b-5bcbdf71f86e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:56.116051 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d5384b55-d7ba-4e65-b26b-5bcbdf71f86e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:56.116903 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d5384b55-d7ba-4e65-b26b-5bcbdf71f86e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:56.125570 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d5384b55-d7ba-4e65-b26b-5bcbdf71f86e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:56.126363 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d5384b55-d7ba-4e65-b26b-5bcbdf71f86e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:58.142868 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d5384b55-d7ba-4e65-b26b-5bcbdf71f86e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:40:58.190984 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d5384b55-d7ba-4e65-b26b-5bcbdf71f86e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e" status: 200 len: 1267 microversion: 2.1 time: 2.112642 Apr 20 18:40:58.227293 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 538/1080] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:56 2021] GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e => generated 1267 bytes in 2150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:59.259363 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c3385244-0c33-4d7e-9dda-1942c24ce949 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:40:59.261180 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c3385244-0c33-4d7e-9dda-1942c24ce949 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:40:59.289326 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c3385244-0c33-4d7e-9dda-1942c24ce949 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:59.293266 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c3385244-0c33-4d7e-9dda-1942c24ce949 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:59.294544 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c3385244-0c33-4d7e-9dda-1942c24ce949 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:40:59.297420 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c3385244-0c33-4d7e-9dda-1942c24ce949 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:40:59.993905 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c3385244-0c33-4d7e-9dda-1942c24ce949 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:00.007177 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c3385244-0c33-4d7e-9dda-1942c24ce949 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e" status: 200 len: 1267 microversion: 2.1 time: 0.765462 Apr 20 18:41:00.020340 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 543/1081] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:40:59 2021] GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e => generated 1267 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:01.026918 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-81282a52-bfa7-49c3-b2c3-0a1133107b21 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:01.028277 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-81282a52-bfa7-49c3-b2c3-0a1133107b21 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:01.086049 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-81282a52-bfa7-49c3-b2c3-0a1133107b21 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:01.087899 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-81282a52-bfa7-49c3-b2c3-0a1133107b21 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:01.091425 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-81282a52-bfa7-49c3-b2c3-0a1133107b21 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:01.093438 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-81282a52-bfa7-49c3-b2c3-0a1133107b21 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:01.642967 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-935ed72e-a79c-4e1a-9517-29e9b8093b50 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Action: 'create', calling method: .version_select at 0x7f418cd4d7b8>, body: {"keypair": {"name": "tempest-TestShelveInstance-231858898"}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:41:01.659363 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-81282a52-bfa7-49c3-b2c3-0a1133107b21 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:01.669359 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-81282a52-bfa7-49c3-b2c3-0a1133107b21 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e" status: 200 len: 1267 microversion: 2.1 time: 0.646009 Apr 20 18:41:01.670302 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-935ed72e-a79c-4e1a-9517-29e9b8093b50 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Getting quotas for project 2b983d94220b40aead19fa67590f0415. Resources: {'key_pairs'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:41:01.670624 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 539/1082] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:01 2021] GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e => generated 1267 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:01.686111 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-935ed72e-a79c-4e1a-9517-29e9b8093b50 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Getting quotas for user 2f077064affd42f6867f45645a8ad78d and project 2b983d94220b40aead19fa67590f0415. Resources: {'key_pairs'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:41:01.887164 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-935ed72e-a79c-4e1a-9517-29e9b8093b50 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Getting quotas for project 2b983d94220b40aead19fa67590f0415. Resources: {'key_pairs'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:41:01.891757 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-935ed72e-a79c-4e1a-9517-29e9b8093b50 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Getting quotas for user 2f077064affd42f6867f45645a8ad78d and project 2b983d94220b40aead19fa67590f0415. Resources: {'key_pairs'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:41:01.906814 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-935ed72e-a79c-4e1a-9517-29e9b8093b50 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.565698 Apr 20 18:41:01.907690 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 544/1083] 10.222.0.25 () {60 vars in 1148 bytes} [Tue Apr 20 18:41:01 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:02.688863 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7b4e0fe2-1207-4b60-8779-e559c1641b21 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:02.690003 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7b4e0fe2-1207-4b60-8779-e559c1641b21 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:02.712308 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7b4e0fe2-1207-4b60-8779-e559c1641b21 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:02.715043 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7b4e0fe2-1207-4b60-8779-e559c1641b21 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:02.716142 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7b4e0fe2-1207-4b60-8779-e559c1641b21 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:02.716855 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7b4e0fe2-1207-4b60-8779-e559c1641b21 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:03.298517 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7b4e0fe2-1207-4b60-8779-e559c1641b21 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:03.330660 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7b4e0fe2-1207-4b60-8779-e559c1641b21 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e" status: 200 len: 1267 microversion: 2.1 time: 0.645886 Apr 20 18:41:03.340570 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 540/1084] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:02 2021] GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e => generated 1267 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:41:04.350369 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d7955389-3686-447d-9a15-705683b94051 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:04.352196 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d7955389-3686-447d-9a15-705683b94051 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:04.374023 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d7955389-3686-447d-9a15-705683b94051 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:04.376808 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d7955389-3686-447d-9a15-705683b94051 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:04.380260 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d7955389-3686-447d-9a15-705683b94051 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:04.381065 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d7955389-3686-447d-9a15-705683b94051 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:05.491079 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d7955389-3686-447d-9a15-705683b94051 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:05.514164 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d7955389-3686-447d-9a15-705683b94051 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e" status: 200 len: 1267 microversion: 2.1 time: 1.166440 Apr 20 18:41:05.517860 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 545/1085] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:04 2021] GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e => generated 1267 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:06.535865 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2eb1a9b4-37a1-4b21-a386-40f958567d64 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:06.537698 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2eb1a9b4-37a1-4b21-a386-40f958567d64 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:06.562576 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2eb1a9b4-37a1-4b21-a386-40f958567d64 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:06.563641 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2eb1a9b4-37a1-4b21-a386-40f958567d64 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:06.566181 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2eb1a9b4-37a1-4b21-a386-40f958567d64 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:06.567013 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2eb1a9b4-37a1-4b21-a386-40f958567d64 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:06.930506 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2eb1a9b4-37a1-4b21-a386-40f958567d64 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:06.940762 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2eb1a9b4-37a1-4b21-a386-40f958567d64 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e" status: 200 len: 1267 microversion: 2.1 time: 0.411275 Apr 20 18:41:06.941714 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 541/1086] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:06 2021] GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e => generated 1267 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:07.892127 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-4cf036ff-176a-4547-98d4-b14eb764d9e7 req-6f2aba7c-f471-49c7-9541-cd7ed81d68bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e", "name": "network-vif-plugged", "status": "completed", "tag": "3f62a456-a3af-4478-ac42-4fa222c97208"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:41:07.893989 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:41:07.893989 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:41:07.906173 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-4cf036ff-176a-4547-98d4-b14eb764d9e7 req-6f2aba7c-f471-49c7-9541-cd7ed81d68bf service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:07.906880 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-4cf036ff-176a-4547-98d4-b14eb764d9e7 req-6f2aba7c-f471-49c7-9541-cd7ed81d68bf service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:07.932340 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-4cf036ff-176a-4547-98d4-b14eb764d9e7 req-6f2aba7c-f471-49c7-9541-cd7ed81d68bf service nova] Creating event network-vif-plugged:3f62a456-a3af-4478-ac42-4fa222c97208 for instance 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e on hv-cinder-78693 Apr 20 18:41:07.949935 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-4cf036ff-176a-4547-98d4-b14eb764d9e7 req-6f2aba7c-f471-49c7-9541-cd7ed81d68bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061734 Apr 20 18:41:07.950969 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 546/1087] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:41:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:41:07.972063 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a3cf4874-b821-43b4-81c3-d1956fb80652 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:07.973168 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a3cf4874-b821-43b4-81c3-d1956fb80652 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:07.990449 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a3cf4874-b821-43b4-81c3-d1956fb80652 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:07.993174 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a3cf4874-b821-43b4-81c3-d1956fb80652 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:07.994919 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a3cf4874-b821-43b4-81c3-d1956fb80652 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:07.995901 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a3cf4874-b821-43b4-81c3-d1956fb80652 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:08.420264 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a3cf4874-b821-43b4-81c3-d1956fb80652 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:08.436149 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a3cf4874-b821-43b4-81c3-d1956fb80652 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e" status: 200 len: 1267 microversion: 2.1 time: 0.469321 Apr 20 18:41:08.437850 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 542/1088] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:07 2021] GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e => generated 1267 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:09.468155 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-780359df-f57d-40da-b8e1-eeadfa9f1d7e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:09.470939 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-780359df-f57d-40da-b8e1-eeadfa9f1d7e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:09.497230 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-780359df-f57d-40da-b8e1-eeadfa9f1d7e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:09.497827 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-780359df-f57d-40da-b8e1-eeadfa9f1d7e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:09.498727 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-780359df-f57d-40da-b8e1-eeadfa9f1d7e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:09.499235 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-780359df-f57d-40da-b8e1-eeadfa9f1d7e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:10.106147 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-780359df-f57d-40da-b8e1-eeadfa9f1d7e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:10.125214 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-780359df-f57d-40da-b8e1-eeadfa9f1d7e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e" status: 200 len: 1267 microversion: 2.1 time: 0.666906 Apr 20 18:41:10.126302 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 547/1089] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:09 2021] GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e => generated 1267 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:11.144221 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f8845d20-be41-4967-914a-e83dd4b7a8de tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:11.145543 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f8845d20-be41-4967-914a-e83dd4b7a8de tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:11.153850 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f8845d20-be41-4967-914a-e83dd4b7a8de tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:11.154371 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f8845d20-be41-4967-914a-e83dd4b7a8de tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:11.155238 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f8845d20-be41-4967-914a-e83dd4b7a8de tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:11.155729 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f8845d20-be41-4967-914a-e83dd4b7a8de tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:11.479379 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f8845d20-be41-4967-914a-e83dd4b7a8de tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:11.491595 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f8845d20-be41-4967-914a-e83dd4b7a8de tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e" status: 200 len: 1455 microversion: 2.1 time: 0.351182 Apr 20 18:41:11.492893 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 543/1090] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:11 2021] GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e => generated 1455 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:11.529069 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6541f58d-9635-4e09-b301-155758b96e66 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:11.529626 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6541f58d-9635-4e09-b301-155758b96e66 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:11.538106 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6541f58d-9635-4e09-b301-155758b96e66 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:11.538619 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6541f58d-9635-4e09-b301-155758b96e66 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:11.539472 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6541f58d-9635-4e09-b301-155758b96e66 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:11.539960 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6541f58d-9635-4e09-b301-155758b96e66 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:12.007317 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6541f58d-9635-4e09-b301-155758b96e66 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:12.017763 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6541f58d-9635-4e09-b301-155758b96e66 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e" status: 200 len: 1455 microversion: 2.1 time: 0.492918 Apr 20 18:41:12.018730 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 548/1091] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:11 2021] GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e => generated 1455 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:15.582343 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-ffe5a691-08c9-4fed-baf3-656c342169cb req-9af2585e-6543-4796-aeae-5cf2d70c558e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e", "tag": "3f62a456-a3af-4478-ac42-4fa222c97208"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:41:15.584839 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:41:15.584839 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:41:15.599631 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-ffe5a691-08c9-4fed-baf3-656c342169cb req-9af2585e-6543-4796-aeae-5cf2d70c558e service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:15.600245 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-ffe5a691-08c9-4fed-baf3-656c342169cb req-9af2585e-6543-4796-aeae-5cf2d70c558e service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:15.620629 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-ffe5a691-08c9-4fed-baf3-656c342169cb req-9af2585e-6543-4796-aeae-5cf2d70c558e service nova] Creating event network-changed:3f62a456-a3af-4478-ac42-4fa222c97208 for instance 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e on hv-cinder-78693 Apr 20 18:41:15.627919 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-ffe5a691-08c9-4fed-baf3-656c342169cb req-9af2585e-6543-4796-aeae-5cf2d70c558e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050445 Apr 20 18:41:15.629472 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 544/1092] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:41:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:41:21.289663 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1555014c-3df7-41ea-8890-dcc1f5f82b41 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-259447444", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-231858898", "security_groups": [{"name": "tempest-secgroup-smoke-1537399235"}], "networks": [{"uuid": "334cb264-de42-4931-bbbb-686b9b5ee47d"}], "block_device_mapping_v2": [{"uuid": "58384226-d95f-47bd-9b22-d4b9f71005e4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:41:21.539749 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.network.neutron [None req-1555014c-3df7-41ea-8890-dcc1f5f82b41 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] validate_networks() for [('334cb264-de42-4931-bbbb-686b9b5ee47d', None, None, None)] {{(pid=100593) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:41:22.162477 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-1555014c-3df7-41ea-8890-dcc1f5f82b41 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Flavor limits 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:41:22.162963 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-1555014c-3df7-41ea-8890-dcc1f5f82b41 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Image limits 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:41:22.163568 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-1555014c-3df7-41ea-8890-dcc1f5f82b41 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Flavor pref 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:41:22.164014 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-1555014c-3df7-41ea-8890-dcc1f5f82b41 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Image pref 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:41:22.164669 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-1555014c-3df7-41ea-8890-dcc1f5f82b41 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:41:22.174526 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1555014c-3df7-41ea-8890-dcc1f5f82b41 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:22.175037 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1555014c-3df7-41ea-8890-dcc1f5f82b41 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:22.175913 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1555014c-3df7-41ea-8890-dcc1f5f82b41 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:22.176409 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1555014c-3df7-41ea-8890-dcc1f5f82b41 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:22.196956 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-1555014c-3df7-41ea-8890-dcc1f5f82b41 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Getting quotas for project 2b983d94220b40aead19fa67590f0415. Resources: {'instances', 'ram', 'cores'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:41:22.202625 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-1555014c-3df7-41ea-8890-dcc1f5f82b41 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Getting quotas for user 2f077064affd42f6867f45645a8ad78d and project 2b983d94220b40aead19fa67590f0415. Resources: {'instances', 'ram', 'cores'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:41:22.331261 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1555014c-3df7-41ea-8890-dcc1f5f82b41 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Going to run 1 instances... {{(pid=100593) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:41:22.333718 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1555014c-3df7-41ea-8890-dcc1f5f82b41 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='58384226-d95f-47bd-9b22-d4b9f71005e4',volume_size=None,volume_type=None)] {{(pid=100593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:41:22.544241 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1555014c-3df7-41ea-8890-dcc1f5f82b41 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.257467 Apr 20 18:41:22.545082 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 549/1093] 10.222.0.25 () {60 vars in 1137 bytes} [Tue Apr 20 18:41:21 2021] POST /compute/v2.1/servers => generated 406 bytes in 1260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:41:22.557072 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-995ccaec-96ed-41b0-b9d4-0577eda31884 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:22.557904 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-995ccaec-96ed-41b0-b9d4-0577eda31884 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:22.690363 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-995ccaec-96ed-41b0-b9d4-0577eda31884 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:22.699616 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-995ccaec-96ed-41b0-b9d4-0577eda31884 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1087 microversion: 2.1 time: 0.146666 Apr 20 18:41:22.700287 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 545/1094] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:22 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1087 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:23.719654 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-dd4f572e-6268-4ea8-b2aa-5121132f59d5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:23.720258 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-dd4f572e-6268-4ea8-b2aa-5121132f59d5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:23.729484 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dd4f572e-6268-4ea8-b2aa-5121132f59d5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:23.730116 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dd4f572e-6268-4ea8-b2aa-5121132f59d5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:23.731575 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dd4f572e-6268-4ea8-b2aa-5121132f59d5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:23.732082 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dd4f572e-6268-4ea8-b2aa-5121132f59d5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:23.868854 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-dd4f572e-6268-4ea8-b2aa-5121132f59d5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:23.879908 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-dd4f572e-6268-4ea8-b2aa-5121132f59d5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1193 microversion: 2.1 time: 0.165285 Apr 20 18:41:23.880700 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 550/1095] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:23 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1193 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:24.901531 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1865c496-3edf-4475-bb1f-a5f8db48184f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:24.902466 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1865c496-3edf-4475-bb1f-a5f8db48184f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:24.913241 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1865c496-3edf-4475-bb1f-a5f8db48184f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:24.913802 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1865c496-3edf-4475-bb1f-a5f8db48184f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:24.914873 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1865c496-3edf-4475-bb1f-a5f8db48184f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:24.915379 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1865c496-3edf-4475-bb1f-a5f8db48184f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:25.426398 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1865c496-3edf-4475-bb1f-a5f8db48184f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:25.439203 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1865c496-3edf-4475-bb1f-a5f8db48184f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1271 microversion: 2.1 time: 0.543490 Apr 20 18:41:25.440000 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 546/1096] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:24 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1271 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:26.462528 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-65e9786d-e349-4557-a0bb-5263e6ff0bde tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:26.463602 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-65e9786d-e349-4557-a0bb-5263e6ff0bde tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:26.480397 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-65e9786d-e349-4557-a0bb-5263e6ff0bde tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:26.481359 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-65e9786d-e349-4557-a0bb-5263e6ff0bde tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:26.482847 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-65e9786d-e349-4557-a0bb-5263e6ff0bde tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:26.483758 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-65e9786d-e349-4557-a0bb-5263e6ff0bde tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:26.707408 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-f7a96d98-5acc-40c5-b37c-1d778070e554 req-6012465c-8839-4a7e-93c8-a64a5f2e4f07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8feff501-cea0-4c8a-a991-593fc8e47fd9", "tag": "518fd836-456c-4e9f-84fc-ed8258cb8385"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:41:26.710593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:41:26.710593 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:41:26.732722 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-f7a96d98-5acc-40c5-b37c-1d778070e554 req-6012465c-8839-4a7e-93c8-a64a5f2e4f07 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:26.733207 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-f7a96d98-5acc-40c5-b37c-1d778070e554 req-6012465c-8839-4a7e-93c8-a64a5f2e4f07 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:26.745217 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-65e9786d-e349-4557-a0bb-5263e6ff0bde tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:26.754235 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-f7a96d98-5acc-40c5-b37c-1d778070e554 req-6012465c-8839-4a7e-93c8-a64a5f2e4f07 service nova] Creating event network-changed:518fd836-456c-4e9f-84fc-ed8258cb8385 for instance 8feff501-cea0-4c8a-a991-593fc8e47fd9 on hv-cinder-78693 Apr 20 18:41:26.759902 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-65e9786d-e349-4557-a0bb-5263e6ff0bde tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1259 microversion: 2.1 time: 0.305917 Apr 20 18:41:26.760313 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-f7a96d98-5acc-40c5-b37c-1d778070e554 req-6012465c-8839-4a7e-93c8-a64a5f2e4f07 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058813 Apr 20 18:41:26.760520 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 551/1097] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:26 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1259 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:26.761189 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 547/1098] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:41:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:41:27.780323 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-dcd271e8-396c-4a96-947a-826d9ef5cca8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:27.781006 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-dcd271e8-396c-4a96-947a-826d9ef5cca8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:27.789178 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dcd271e8-396c-4a96-947a-826d9ef5cca8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:27.790021 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dcd271e8-396c-4a96-947a-826d9ef5cca8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:27.791096 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dcd271e8-396c-4a96-947a-826d9ef5cca8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:27.791822 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dcd271e8-396c-4a96-947a-826d9ef5cca8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:28.286595 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-dcd271e8-396c-4a96-947a-826d9ef5cca8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:28.298274 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-dcd271e8-396c-4a96-947a-826d9ef5cca8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1259 microversion: 2.1 time: 0.523035 Apr 20 18:41:28.298936 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 552/1099] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:27 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1259 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:29.317875 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ad54dc17-f914-4d24-b59c-982e6ede0e66 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:29.318650 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ad54dc17-f914-4d24-b59c-982e6ede0e66 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:29.329141 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ad54dc17-f914-4d24-b59c-982e6ede0e66 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:29.329710 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ad54dc17-f914-4d24-b59c-982e6ede0e66 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:29.330560 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ad54dc17-f914-4d24-b59c-982e6ede0e66 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:29.331056 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ad54dc17-f914-4d24-b59c-982e6ede0e66 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:29.619825 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ad54dc17-f914-4d24-b59c-982e6ede0e66 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:29.629609 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ad54dc17-f914-4d24-b59c-982e6ede0e66 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1259 microversion: 2.1 time: 0.316349 Apr 20 18:41:29.630174 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 548/1100] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:29 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1259 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:30.648150 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b897ed4d-74c4-490a-98d0-7756d5b32dc4 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:30.648834 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b897ed4d-74c4-490a-98d0-7756d5b32dc4 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:30.657321 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b897ed4d-74c4-490a-98d0-7756d5b32dc4 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:30.657869 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b897ed4d-74c4-490a-98d0-7756d5b32dc4 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:30.658720 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b897ed4d-74c4-490a-98d0-7756d5b32dc4 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:30.659219 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b897ed4d-74c4-490a-98d0-7756d5b32dc4 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:30.884791 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b897ed4d-74c4-490a-98d0-7756d5b32dc4 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:30.894802 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b897ed4d-74c4-490a-98d0-7756d5b32dc4 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1259 microversion: 2.1 time: 0.250687 Apr 20 18:41:30.895438 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 553/1101] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:30 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1259 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:31.912796 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-a614da65-1b27-42ae-9c21-cbb5893805d8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:31.913511 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-a614da65-1b27-42ae-9c21-cbb5893805d8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:31.921939 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a614da65-1b27-42ae-9c21-cbb5893805d8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:31.922439 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a614da65-1b27-42ae-9c21-cbb5893805d8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:31.923283 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a614da65-1b27-42ae-9c21-cbb5893805d8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:31.923776 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-a614da65-1b27-42ae-9c21-cbb5893805d8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:32.152994 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-a614da65-1b27-42ae-9c21-cbb5893805d8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:32.162385 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-a614da65-1b27-42ae-9c21-cbb5893805d8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1259 microversion: 2.1 time: 0.253859 Apr 20 18:41:32.163048 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 549/1102] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:31 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1259 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:33.181219 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-76507fa3-0ab2-42b4-9db6-0b77d3faf85c tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:33.182064 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-76507fa3-0ab2-42b4-9db6-0b77d3faf85c tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:33.192200 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-76507fa3-0ab2-42b4-9db6-0b77d3faf85c tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:33.192703 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-76507fa3-0ab2-42b4-9db6-0b77d3faf85c tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:33.193575 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-76507fa3-0ab2-42b4-9db6-0b77d3faf85c tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:33.194070 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-76507fa3-0ab2-42b4-9db6-0b77d3faf85c tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:33.429919 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-76507fa3-0ab2-42b4-9db6-0b77d3faf85c tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:33.439767 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-76507fa3-0ab2-42b4-9db6-0b77d3faf85c tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1259 microversion: 2.1 time: 0.262665 Apr 20 18:41:33.440321 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 554/1103] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:33 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1259 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:34.458333 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b9277e45-3b53-40b4-8bd2-c67b69bd1fd9 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:34.459618 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b9277e45-3b53-40b4-8bd2-c67b69bd1fd9 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:34.468880 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b9277e45-3b53-40b4-8bd2-c67b69bd1fd9 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:34.469430 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b9277e45-3b53-40b4-8bd2-c67b69bd1fd9 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:34.470291 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b9277e45-3b53-40b4-8bd2-c67b69bd1fd9 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:34.470791 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b9277e45-3b53-40b4-8bd2-c67b69bd1fd9 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:34.767401 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b9277e45-3b53-40b4-8bd2-c67b69bd1fd9 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:34.777378 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b9277e45-3b53-40b4-8bd2-c67b69bd1fd9 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1259 microversion: 2.1 time: 0.322495 Apr 20 18:41:34.777970 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 550/1104] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:34 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1259 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:35.795160 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-cf7a1b86-08b4-40ea-bb80-64d9c55910bf tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:35.795832 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-cf7a1b86-08b4-40ea-bb80-64d9c55910bf tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:35.803976 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cf7a1b86-08b4-40ea-bb80-64d9c55910bf tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:35.804489 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cf7a1b86-08b4-40ea-bb80-64d9c55910bf tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:35.805348 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cf7a1b86-08b4-40ea-bb80-64d9c55910bf tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:35.805880 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cf7a1b86-08b4-40ea-bb80-64d9c55910bf tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:36.051225 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-cf7a1b86-08b4-40ea-bb80-64d9c55910bf tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:36.061274 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-cf7a1b86-08b4-40ea-bb80-64d9c55910bf tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1259 microversion: 2.1 time: 0.270112 Apr 20 18:41:36.062302 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 555/1105] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:35 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1259 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:37.079582 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-48ec0717-830d-4f47-98c1-4cdca57cb8c8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:37.080217 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-48ec0717-830d-4f47-98c1-4cdca57cb8c8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:37.088488 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-48ec0717-830d-4f47-98c1-4cdca57cb8c8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:37.089000 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-48ec0717-830d-4f47-98c1-4cdca57cb8c8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:37.090182 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-48ec0717-830d-4f47-98c1-4cdca57cb8c8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:37.090390 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-48ec0717-830d-4f47-98c1-4cdca57cb8c8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:37.326171 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-48ec0717-830d-4f47-98c1-4cdca57cb8c8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:37.335808 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-48ec0717-830d-4f47-98c1-4cdca57cb8c8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1259 microversion: 2.1 time: 0.260258 Apr 20 18:41:37.337829 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 551/1106] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:37 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1259 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:41:37.721492 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-5cfe2884-9abf-4e50-acf7-0b3ea7243ca2 req-73b88ff0-b61c-4190-bd53-72ecc3fb18e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8feff501-cea0-4c8a-a991-593fc8e47fd9", "name": "network-vif-plugged", "status": "completed", "tag": "518fd836-456c-4e9f-84fc-ed8258cb8385"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:41:37.723831 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:41:37.723831 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:41:37.735688 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-5cfe2884-9abf-4e50-acf7-0b3ea7243ca2 req-73b88ff0-b61c-4190-bd53-72ecc3fb18e9 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:37.736233 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-5cfe2884-9abf-4e50-acf7-0b3ea7243ca2 req-73b88ff0-b61c-4190-bd53-72ecc3fb18e9 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:37.755822 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-5cfe2884-9abf-4e50-acf7-0b3ea7243ca2 req-73b88ff0-b61c-4190-bd53-72ecc3fb18e9 service nova] Creating event network-vif-plugged:518fd836-456c-4e9f-84fc-ed8258cb8385 for instance 8feff501-cea0-4c8a-a991-593fc8e47fd9 on hv-cinder-78693 Apr 20 18:41:37.762282 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-5cfe2884-9abf-4e50-acf7-0b3ea7243ca2 req-73b88ff0-b61c-4190-bd53-72ecc3fb18e9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044504 Apr 20 18:41:37.762976 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 556/1107] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:41:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:41:38.364322 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1d21970f-ef36-4196-b450-3f525ea49127 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:38.364997 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1d21970f-ef36-4196-b450-3f525ea49127 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:38.374465 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1d21970f-ef36-4196-b450-3f525ea49127 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:38.374955 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1d21970f-ef36-4196-b450-3f525ea49127 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:38.375813 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1d21970f-ef36-4196-b450-3f525ea49127 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:38.376309 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1d21970f-ef36-4196-b450-3f525ea49127 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:38.605273 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-1d21970f-ef36-4196-b450-3f525ea49127 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:38.623634 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1d21970f-ef36-4196-b450-3f525ea49127 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1259 microversion: 2.1 time: 0.262848 Apr 20 18:41:38.624758 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 552/1108] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:38 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1259 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:39.654956 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3f957a55-c985-4afc-b888-27fc206d8015 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:39.656262 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3f957a55-c985-4afc-b888-27fc206d8015 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:39.664751 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3f957a55-c985-4afc-b888-27fc206d8015 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:39.665251 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3f957a55-c985-4afc-b888-27fc206d8015 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:39.666143 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3f957a55-c985-4afc-b888-27fc206d8015 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:39.666639 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3f957a55-c985-4afc-b888-27fc206d8015 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:39.893750 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3f957a55-c985-4afc-b888-27fc206d8015 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:39.902923 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3f957a55-c985-4afc-b888-27fc206d8015 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1259 microversion: 2.1 time: 0.255828 Apr 20 18:41:39.903575 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 557/1109] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:39 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1259 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:40.928019 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8a2836b7-7842-4818-89d1-507c1d06dbe2 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:40.928740 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8a2836b7-7842-4818-89d1-507c1d06dbe2 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:40.938815 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8a2836b7-7842-4818-89d1-507c1d06dbe2 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:40.939414 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8a2836b7-7842-4818-89d1-507c1d06dbe2 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:40.940384 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8a2836b7-7842-4818-89d1-507c1d06dbe2 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:40.940986 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8a2836b7-7842-4818-89d1-507c1d06dbe2 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:41.217997 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8a2836b7-7842-4818-89d1-507c1d06dbe2 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:41.228756 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8a2836b7-7842-4818-89d1-507c1d06dbe2 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1259 microversion: 2.1 time: 0.304062 Apr 20 18:41:41.228756 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 553/1110] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:40 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1259 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:42.246227 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-5b774fc6-3e15-4629-a6a0-85ca39cd765b tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:42.246835 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-5b774fc6-3e15-4629-a6a0-85ca39cd765b tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:42.255250 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5b774fc6-3e15-4629-a6a0-85ca39cd765b tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:42.255758 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5b774fc6-3e15-4629-a6a0-85ca39cd765b tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:42.256616 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5b774fc6-3e15-4629-a6a0-85ca39cd765b tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:42.257134 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-5b774fc6-3e15-4629-a6a0-85ca39cd765b tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:42.486685 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-5b774fc6-3e15-4629-a6a0-85ca39cd765b tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:42.496056 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-5b774fc6-3e15-4629-a6a0-85ca39cd765b tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1444 microversion: 2.1 time: 0.253806 Apr 20 18:41:42.496761 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 558/1111] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:42 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1444 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:42.513834 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ca079670-79ef-4606-9275-aad085e60321 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:42.514502 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ca079670-79ef-4606-9275-aad085e60321 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:42.522764 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ca079670-79ef-4606-9275-aad085e60321 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:42.523274 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ca079670-79ef-4606-9275-aad085e60321 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:42.524126 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ca079670-79ef-4606-9275-aad085e60321 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:42.524614 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ca079670-79ef-4606-9275-aad085e60321 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:42.765794 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ca079670-79ef-4606-9275-aad085e60321 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:42.774813 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ca079670-79ef-4606-9275-aad085e60321 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1444 microversion: 2.1 time: 0.265208 Apr 20 18:41:42.775455 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 554/1112] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:42 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1444 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:45.777751 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-f56881cb-a934-4d3e-be26-c9ee5ccdec51 req-67296a47-51bc-4e51-9e34-f6474d650932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8feff501-cea0-4c8a-a991-593fc8e47fd9", "tag": "518fd836-456c-4e9f-84fc-ed8258cb8385"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:41:45.780359 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:41:45.780359 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:41:45.790077 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-f56881cb-a934-4d3e-be26-c9ee5ccdec51 req-67296a47-51bc-4e51-9e34-f6474d650932 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:45.790587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-f56881cb-a934-4d3e-be26-c9ee5ccdec51 req-67296a47-51bc-4e51-9e34-f6474d650932 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:45.810432 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-f56881cb-a934-4d3e-be26-c9ee5ccdec51 req-67296a47-51bc-4e51-9e34-f6474d650932 service nova] Creating event network-changed:518fd836-456c-4e9f-84fc-ed8258cb8385 for instance 8feff501-cea0-4c8a-a991-593fc8e47fd9 on hv-cinder-78693 Apr 20 18:41:45.815954 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-f56881cb-a934-4d3e-be26-c9ee5ccdec51 req-67296a47-51bc-4e51-9e34-f6474d650932 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042642 Apr 20 18:41:45.816779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 559/1113] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:41:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:41:47.757754 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3f5a2b7a-fff2-477a-bab5-5f6b1586d4f7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1169882532", "imageRef": "ba8326d8-5d1b-42a2-a65e-f1108a025e30", "flavorRef": "452"}} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:41:47.829717 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.network.neutron [None req-3f5a2b7a-fff2-477a-bab5-5f6b1586d4f7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] validate_networks() for None {{(pid=100592) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:41:48.120489 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-3f5a2b7a-fff2-477a-bab5-5f6b1586d4f7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Flavor limits 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:41:48.120967 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-3f5a2b7a-fff2-477a-bab5-5f6b1586d4f7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Image limits 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:41:48.121600 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-3f5a2b7a-fff2-477a-bab5-5f6b1586d4f7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Flavor pref 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:41:48.122023 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-3f5a2b7a-fff2-477a-bab5-5f6b1586d4f7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Image pref 0:0:0 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:41:48.122493 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-3f5a2b7a-fff2-477a-bab5-5f6b1586d4f7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100592) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:41:48.131469 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3f5a2b7a-fff2-477a-bab5-5f6b1586d4f7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:48.131975 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3f5a2b7a-fff2-477a-bab5-5f6b1586d4f7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:48.132858 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3f5a2b7a-fff2-477a-bab5-5f6b1586d4f7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:48.133351 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3f5a2b7a-fff2-477a-bab5-5f6b1586d4f7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:48.153046 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-3f5a2b7a-fff2-477a-bab5-5f6b1586d4f7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Getting quotas for project ec9b3594d84d4ad68aa22705d6f5971d. Resources: {'instances', 'ram', 'cores'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:41:48.157356 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-3f5a2b7a-fff2-477a-bab5-5f6b1586d4f7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Getting quotas for user e7b91a7216fd4049adb970f1c3d86e8f and project ec9b3594d84d4ad68aa22705d6f5971d. Resources: {'instances', 'ram', 'cores'} {{(pid=100592) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:41:48.169079 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3f5a2b7a-fff2-477a-bab5-5f6b1586d4f7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Going to run 1 instances... {{(pid=100592) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:41:48.171717 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3f5a2b7a-fff2-477a-bab5-5f6b1586d4f7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] [instance: 2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba8326d8-5d1b-42a2-a65e-f1108a025e30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100592) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:41:48.223368 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3f5a2b7a-fff2-477a-bab5-5f6b1586d4f7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.469752 Apr 20 18:41:48.224091 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 555/1114] 10.222.0.25 () {60 vars in 1137 bytes} [Tue Apr 20 18:41:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:41:48.236944 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d2a86fab-491d-49a5-afcd-b09c1b64faa5 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:48.237779 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d2a86fab-491d-49a5-afcd-b09c1b64faa5 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] [instance: 2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:48.319258 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d2a86fab-491d-49a5-afcd-b09c1b64faa5 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b91a7216fd4049adb970f1c3d86e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9b3594d84d4ad68aa22705d6f5971d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:48.328082 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d2a86fab-491d-49a5-afcd-b09c1b64faa5 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] 10.222.0.25 "GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5" status: 200 len: 1215 microversion: 2.1 time: 0.095572 Apr 20 18:41:48.328727 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 560/1115] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:48 2021] GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5 => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:49.346760 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3c08a9ef-d99c-4d09-86e8-fb0bd81e7fea tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:49.348668 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3c08a9ef-d99c-4d09-86e8-fb0bd81e7fea tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] [instance: 2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:49.358022 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c08a9ef-d99c-4d09-86e8-fb0bd81e7fea tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:49.358537 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c08a9ef-d99c-4d09-86e8-fb0bd81e7fea tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:49.359405 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c08a9ef-d99c-4d09-86e8-fb0bd81e7fea tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:49.359898 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3c08a9ef-d99c-4d09-86e8-fb0bd81e7fea tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:49.522020 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3c08a9ef-d99c-4d09-86e8-fb0bd81e7fea tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b91a7216fd4049adb970f1c3d86e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9b3594d84d4ad68aa22705d6f5971d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:49.532089 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3c08a9ef-d99c-4d09-86e8-fb0bd81e7fea tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] 10.222.0.25 "GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5" status: 200 len: 1285 microversion: 2.1 time: 0.189511 Apr 20 18:41:49.532946 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 556/1116] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:49 2021] GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5 => generated 1285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:50.551905 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-28a1652b-5697-4037-90eb-0eba252d4ec7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:50.553149 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-28a1652b-5697-4037-90eb-0eba252d4ec7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] [instance: 2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:50.563105 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-28a1652b-5697-4037-90eb-0eba252d4ec7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:50.563611 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-28a1652b-5697-4037-90eb-0eba252d4ec7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:50.564511 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-28a1652b-5697-4037-90eb-0eba252d4ec7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:50.564954 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-28a1652b-5697-4037-90eb-0eba252d4ec7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:50.790067 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-28a1652b-5697-4037-90eb-0eba252d4ec7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b91a7216fd4049adb970f1c3d86e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9b3594d84d4ad68aa22705d6f5971d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:50.800098 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-28a1652b-5697-4037-90eb-0eba252d4ec7 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] 10.222.0.25 "GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5" status: 200 len: 1315 microversion: 2.1 time: 0.252112 Apr 20 18:41:50.801021 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 561/1117] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:50 2021] GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:51.606729 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-419628d1-e7ee-4287-995a-e1e111421b02 req-8d96eea5-eaa4-46b8-81c6-f2e31b8a9813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5", "tag": "8d3ed48b-b6f1-48be-9b1a-2d1305f9d840"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:41:51.608586 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:41:51.608586 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:41:51.618377 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-419628d1-e7ee-4287-995a-e1e111421b02 req-8d96eea5-eaa4-46b8-81c6-f2e31b8a9813 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:51.619265 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-419628d1-e7ee-4287-995a-e1e111421b02 req-8d96eea5-eaa4-46b8-81c6-f2e31b8a9813 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:51.640092 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-419628d1-e7ee-4287-995a-e1e111421b02 req-8d96eea5-eaa4-46b8-81c6-f2e31b8a9813 service nova] Creating event network-changed:8d3ed48b-b6f1-48be-9b1a-2d1305f9d840 for instance 2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5 on hv-cinder-78693 Apr 20 18:41:51.650285 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-419628d1-e7ee-4287-995a-e1e111421b02 req-8d96eea5-eaa4-46b8-81c6-f2e31b8a9813 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047361 Apr 20 18:41:51.651737 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 557/1118] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:41:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:41:51.819719 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4819c633-41a3-4ba4-9444-618bc9d6c84b tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:51.820481 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4819c633-41a3-4ba4-9444-618bc9d6c84b tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] [instance: 2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:51.829698 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4819c633-41a3-4ba4-9444-618bc9d6c84b tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:51.830203 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4819c633-41a3-4ba4-9444-618bc9d6c84b tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:51.831051 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4819c633-41a3-4ba4-9444-618bc9d6c84b tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:51.831542 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4819c633-41a3-4ba4-9444-618bc9d6c84b tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:52.069128 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4819c633-41a3-4ba4-9444-618bc9d6c84b tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b91a7216fd4049adb970f1c3d86e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9b3594d84d4ad68aa22705d6f5971d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:52.078617 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4819c633-41a3-4ba4-9444-618bc9d6c84b tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] 10.222.0.25 "GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5" status: 200 len: 1315 microversion: 2.1 time: 0.262964 Apr 20 18:41:52.079278 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 562/1119] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:51 2021] GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:53.097570 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9b910538-b901-4b35-805d-07b1b313b899 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:53.098350 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9b910538-b901-4b35-805d-07b1b313b899 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] [instance: 2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:53.107509 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9b910538-b901-4b35-805d-07b1b313b899 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:53.108155 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9b910538-b901-4b35-805d-07b1b313b899 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:53.108893 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9b910538-b901-4b35-805d-07b1b313b899 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:53.109381 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9b910538-b901-4b35-805d-07b1b313b899 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:53.391727 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9b910538-b901-4b35-805d-07b1b313b899 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b91a7216fd4049adb970f1c3d86e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9b3594d84d4ad68aa22705d6f5971d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:53.400951 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9b910538-b901-4b35-805d-07b1b313b899 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] 10.222.0.25 "GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5" status: 200 len: 1315 microversion: 2.1 time: 0.308000 Apr 20 18:41:53.401806 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 558/1120] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:53 2021] GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:54.419885 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ac3b8611-8f45-4bac-a979-56ecae36849f tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:54.420557 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ac3b8611-8f45-4bac-a979-56ecae36849f tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] [instance: 2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:54.428605 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ac3b8611-8f45-4bac-a979-56ecae36849f tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:54.429114 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ac3b8611-8f45-4bac-a979-56ecae36849f tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:54.429993 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ac3b8611-8f45-4bac-a979-56ecae36849f tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:54.430492 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ac3b8611-8f45-4bac-a979-56ecae36849f tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:54.655122 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ac3b8611-8f45-4bac-a979-56ecae36849f tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b91a7216fd4049adb970f1c3d86e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9b3594d84d4ad68aa22705d6f5971d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:54.663998 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ac3b8611-8f45-4bac-a979-56ecae36849f tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] 10.222.0.25 "GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5" status: 200 len: 1315 microversion: 2.1 time: 0.248852 Apr 20 18:41:54.664662 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 563/1121] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:54 2021] GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:55.683553 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4206ac93-3dfe-4ece-951d-038bd7bc5aaf tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:55.684275 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4206ac93-3dfe-4ece-951d-038bd7bc5aaf tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] [instance: 2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:55.692333 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4206ac93-3dfe-4ece-951d-038bd7bc5aaf tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:55.692842 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4206ac93-3dfe-4ece-951d-038bd7bc5aaf tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:55.693728 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4206ac93-3dfe-4ece-951d-038bd7bc5aaf tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:55.694224 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4206ac93-3dfe-4ece-951d-038bd7bc5aaf tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:55.931324 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4206ac93-3dfe-4ece-951d-038bd7bc5aaf tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b91a7216fd4049adb970f1c3d86e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9b3594d84d4ad68aa22705d6f5971d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:55.941749 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4206ac93-3dfe-4ece-951d-038bd7bc5aaf tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] 10.222.0.25 "GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5" status: 200 len: 1315 microversion: 2.1 time: 0.262721 Apr 20 18:41:55.942419 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 559/1122] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:55 2021] GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:56.960608 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-50824046-9e31-4076-972b-a1d86749d904 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:56.961371 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-50824046-9e31-4076-972b-a1d86749d904 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] [instance: 2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:56.969703 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-50824046-9e31-4076-972b-a1d86749d904 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:56.970210 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-50824046-9e31-4076-972b-a1d86749d904 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:56.971060 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-50824046-9e31-4076-972b-a1d86749d904 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:56.971545 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-50824046-9e31-4076-972b-a1d86749d904 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:57.194346 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-50824046-9e31-4076-972b-a1d86749d904 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b91a7216fd4049adb970f1c3d86e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9b3594d84d4ad68aa22705d6f5971d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:57.204131 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-50824046-9e31-4076-972b-a1d86749d904 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] 10.222.0.25 "GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5" status: 200 len: 1315 microversion: 2.1 time: 0.247485 Apr 20 18:41:57.204823 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 564/1123] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:56 2021] GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:57.522498 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-ecfcb4b8-b613-49ab-8cbf-ac60542841b0 req-7aaf1f21-7544-4c18-9152-9fba3a61ba0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5", "name": "network-vif-plugged", "status": "completed", "tag": "8d3ed48b-b6f1-48be-9b1a-2d1305f9d840"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:41:57.524257 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:41:57.524257 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:41:57.534036 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-ecfcb4b8-b613-49ab-8cbf-ac60542841b0 req-7aaf1f21-7544-4c18-9152-9fba3a61ba0d service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:57.534534 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-ecfcb4b8-b613-49ab-8cbf-ac60542841b0 req-7aaf1f21-7544-4c18-9152-9fba3a61ba0d service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:57.552467 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-ecfcb4b8-b613-49ab-8cbf-ac60542841b0 req-7aaf1f21-7544-4c18-9152-9fba3a61ba0d service nova] Creating event network-vif-plugged:8d3ed48b-b6f1-48be-9b1a-2d1305f9d840 for instance 2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5 on hv-cinder-78693 Apr 20 18:41:57.559078 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-ecfcb4b8-b613-49ab-8cbf-ac60542841b0 req-7aaf1f21-7544-4c18-9152-9fba3a61ba0d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040270 Apr 20 18:41:57.559764 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 560/1124] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:41:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:41:58.223579 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8f284c68-1878-4681-89af-1595400ce24a tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:58.224176 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8f284c68-1878-4681-89af-1595400ce24a tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] [instance: 2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:58.232987 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8f284c68-1878-4681-89af-1595400ce24a tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:58.233535 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8f284c68-1878-4681-89af-1595400ce24a tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:58.234409 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8f284c68-1878-4681-89af-1595400ce24a tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:58.234909 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8f284c68-1878-4681-89af-1595400ce24a tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:58.473188 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8f284c68-1878-4681-89af-1595400ce24a tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b91a7216fd4049adb970f1c3d86e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9b3594d84d4ad68aa22705d6f5971d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:58.484251 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8f284c68-1878-4681-89af-1595400ce24a tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] 10.222.0.25 "GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5" status: 200 len: 1315 microversion: 2.1 time: 0.264552 Apr 20 18:41:58.484816 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 565/1125] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:58 2021] GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:59.504144 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6e53b27a-b7fc-4cd8-9121-42d3637bafa9 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:59.504956 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6e53b27a-b7fc-4cd8-9121-42d3637bafa9 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] [instance: 2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:59.514210 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6e53b27a-b7fc-4cd8-9121-42d3637bafa9 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:59.514724 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6e53b27a-b7fc-4cd8-9121-42d3637bafa9 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:59.515588 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6e53b27a-b7fc-4cd8-9121-42d3637bafa9 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:59.516090 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6e53b27a-b7fc-4cd8-9121-42d3637bafa9 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:59.746665 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6e53b27a-b7fc-4cd8-9121-42d3637bafa9 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b91a7216fd4049adb970f1c3d86e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9b3594d84d4ad68aa22705d6f5971d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:41:59.764778 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6e53b27a-b7fc-4cd8-9121-42d3637bafa9 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] 10.222.0.25 "GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5" status: 200 len: 1465 microversion: 2.1 time: 0.264915 Apr 20 18:41:59.766055 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 561/1126] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:41:59 2021] GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5 => generated 1465 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:59.854806 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9776b286-74ef-4b8f-9202-153499ee0d50 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:41:59.855294 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9776b286-74ef-4b8f-9202-153499ee0d50 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] [instance: 2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:41:59.863589 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9776b286-74ef-4b8f-9202-153499ee0d50 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:59.864099 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9776b286-74ef-4b8f-9202-153499ee0d50 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:59.864951 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9776b286-74ef-4b8f-9202-153499ee0d50 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:41:59.865494 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9776b286-74ef-4b8f-9202-153499ee0d50 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:41:59.936206 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9776b286-74ef-4b8f-9202-153499ee0d50 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] [instance: 2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5] Going to try to terminate instance {{(pid=100593) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:42:00.056927 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9776b286-74ef-4b8f-9202-153499ee0d50 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5" status: 204 len: 0 microversion: 2.1 time: 0.205936 Apr 20 18:42:00.058162 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 566/1127] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:41:59 2021] DELETE /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:42:00.067156 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-45bb2e09-b308-44d6-973b-5e8547b58b0b tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:00.067850 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-45bb2e09-b308-44d6-973b-5e8547b58b0b tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] [instance: 2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:00.076606 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-45bb2e09-b308-44d6-973b-5e8547b58b0b tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:00.077119 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-45bb2e09-b308-44d6-973b-5e8547b58b0b tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:00.078005 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-45bb2e09-b308-44d6-973b-5e8547b58b0b tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:00.078500 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-45bb2e09-b308-44d6-973b-5e8547b58b0b tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:00.306572 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-45bb2e09-b308-44d6-973b-5e8547b58b0b tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b91a7216fd4049adb970f1c3d86e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9b3594d84d4ad68aa22705d6f5971d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:00.316286 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-45bb2e09-b308-44d6-973b-5e8547b58b0b tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] 10.222.0.25 "GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5" status: 200 len: 1471 microversion: 2.1 time: 0.253153 Apr 20 18:42:00.316858 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 562/1128] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:00 2021] GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5 => generated 1471 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:01.337558 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b7f1e95a-a9e7-4943-8d9f-40e0dc1db811 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:01.338337 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b7f1e95a-a9e7-4943-8d9f-40e0dc1db811 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] [instance: 2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:01.346810 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b7f1e95a-a9e7-4943-8d9f-40e0dc1db811 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:01.347322 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b7f1e95a-a9e7-4943-8d9f-40e0dc1db811 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:01.348176 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b7f1e95a-a9e7-4943-8d9f-40e0dc1db811 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:01.348671 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b7f1e95a-a9e7-4943-8d9f-40e0dc1db811 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:01.576247 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b7f1e95a-a9e7-4943-8d9f-40e0dc1db811 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b91a7216fd4049adb970f1c3d86e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9b3594d84d4ad68aa22705d6f5971d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:01.585754 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b7f1e95a-a9e7-4943-8d9f-40e0dc1db811 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] 10.222.0.25 "GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5" status: 200 len: 1471 microversion: 2.1 time: 0.252861 Apr 20 18:42:01.586659 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 567/1129] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:01 2021] GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5 => generated 1471 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:02.605716 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-0b44d745-924c-4151-9c19-ca41c570f678 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:02.606387 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-0b44d745-924c-4151-9c19-ca41c570f678 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] [instance: 2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:02.614268 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0b44d745-924c-4151-9c19-ca41c570f678 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:02.614768 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0b44d745-924c-4151-9c19-ca41c570f678 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:02.615604 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0b44d745-924c-4151-9c19-ca41c570f678 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:02.616091 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-0b44d745-924c-4151-9c19-ca41c570f678 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:03.001615 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-0b44d745-924c-4151-9c19-ca41c570f678 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b91a7216fd4049adb970f1c3d86e8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9b3594d84d4ad68aa22705d6f5971d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:03.014209 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-0b44d745-924c-4151-9c19-ca41c570f678 tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] 10.222.0.25 "GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5" status: 200 len: 1471 microversion: 2.1 time: 0.410743 Apr 20 18:42:03.014209 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 563/1130] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:02 2021] GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5 => generated 1471 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:03.126688 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-1c234376-37b4-4987-8154-4fd147c1e592 req-1d2a9554-a3e1-4cf4-95be-4e60312b7365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5", "name": "network-vif-deleted", "tag": "8d3ed48b-b6f1-48be-9b1a-2d1305f9d840"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:42:03.128717 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:42:03.128717 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:42:03.140375 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-1c234376-37b4-4987-8154-4fd147c1e592 req-1d2a9554-a3e1-4cf4-95be-4e60312b7365 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:03.141160 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-1c234376-37b4-4987-8154-4fd147c1e592 req-1d2a9554-a3e1-4cf4-95be-4e60312b7365 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:03.162028 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-1c234376-37b4-4987-8154-4fd147c1e592 req-1d2a9554-a3e1-4cf4-95be-4e60312b7365 service nova] Creating event network-vif-deleted:8d3ed48b-b6f1-48be-9b1a-2d1305f9d840 for instance 2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5 on hv-cinder-78693 Apr 20 18:42:03.168589 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-1c234376-37b4-4987-8154-4fd147c1e592 req-1d2a9554-a3e1-4cf4-95be-4e60312b7365 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045644 Apr 20 18:42:03.169541 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 568/1131] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:42:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:42:04.032388 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-be8fe0f1-7d1f-404f-b59a-45e7a24375fb tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:04.033110 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-be8fe0f1-7d1f-404f-b59a-45e7a24375fb tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] [instance: 2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:04.040993 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-be8fe0f1-7d1f-404f-b59a-45e7a24375fb tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:04.042135 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-be8fe0f1-7d1f-404f-b59a-45e7a24375fb tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:04.042961 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-be8fe0f1-7d1f-404f-b59a-45e7a24375fb tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:04.043455 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-be8fe0f1-7d1f-404f-b59a-45e7a24375fb tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:04.099624 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-be8fe0f1-7d1f-404f-b59a-45e7a24375fb tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] HTTP exception thrown: Instance 2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5 could not be found. Apr 20 18:42:04.100573 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-be8fe0f1-7d1f-404f-b59a-45e7a24375fb tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] Returning 404 to user: Instance 2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5 could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:42:04.101522 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-be8fe0f1-7d1f-404f-b59a-45e7a24375fb tempest-VolumesNegativeTest-1798130655 tempest-VolumesNegativeTest-1798130655-project] 10.222.0.25 "GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5" status: 404 len: 111 microversion: 2.1 time: 0.073399 Apr 20 18:42:04.102158 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 564/1132] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:04 2021] GET /compute/v2.1/servers/2afbd0f0-9b9d-4c3d-a0e5-e93c6f78c1f5 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:42:25.224210 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:42:25.224957 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: Tue Apr 20 18:42:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:42:52.803653 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2fe6ca38-b8b8-47ce-8082-ab2191fc4c2f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-47228100", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1782040926", "security_groups": [{"name": "tempest-secgroup-smoke-1408344531"}], "block_device_mapping_v2": [{"uuid": "1874c12e-4796-4d7d-99e1-2f23d7c25266", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8bd2d403-a674-4166-b6a7-876b78a5d8d4"}]}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:42:52.973039 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.network.neutron [None req-2fe6ca38-b8b8-47ce-8082-ab2191fc4c2f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] validate_networks() for [('8bd2d403-a674-4166-b6a7-876b78a5d8d4', None, None, None)] {{(pid=100593) validate_networks /opt/stack/nova/nova/network/neutron.py:2368}} Apr 20 18:42:53.688188 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-2fe6ca38-b8b8-47ce-8082-ab2191fc4c2f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Flavor limits 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:42:53.688783 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-2fe6ca38-b8b8-47ce-8082-ab2191fc4c2f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Image limits 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Apr 20 18:42:53.689365 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-2fe6ca38-b8b8-47ce-8082-ab2191fc4c2f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Flavor pref 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:42:53.689864 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-2fe6ca38-b8b8-47ce-8082-ab2191fc4c2f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Image pref 0:0:0 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Apr 20 18:42:53.690324 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.virt.hardware [None req-2fe6ca38-b8b8-47ce-8082-ab2191fc4c2f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Apr 20 18:42:53.699293 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2fe6ca38-b8b8-47ce-8082-ab2191fc4c2f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:53.699799 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2fe6ca38-b8b8-47ce-8082-ab2191fc4c2f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:53.700666 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2fe6ca38-b8b8-47ce-8082-ab2191fc4c2f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:53.701175 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2fe6ca38-b8b8-47ce-8082-ab2191fc4c2f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:53.719392 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-2fe6ca38-b8b8-47ce-8082-ab2191fc4c2f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Getting quotas for project d38b0824b83f40c9874ffbc291951949. Resources: {'instances', 'ram', 'cores'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:388}} Apr 20 18:42:53.723595 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.quota [None req-2fe6ca38-b8b8-47ce-8082-ab2191fc4c2f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Getting quotas for user 7a04013dbac84c5f93bdb7946e50d21d and project d38b0824b83f40c9874ffbc291951949. Resources: {'instances', 'ram', 'cores'} {{(pid=100593) _get_quotas /opt/stack/nova/nova/quota.py:380}} Apr 20 18:42:53.831164 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2fe6ca38-b8b8-47ce-8082-ab2191fc4c2f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Going to run 1 instances... {{(pid=100593) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 20 18:42:53.833761 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2fe6ca38-b8b8-47ce-8082-ab2191fc4c2f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: fdef06ea-282e-4514-a2be-5b39a060c298] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1874c12e-4796-4d7d-99e1-2f23d7c25266',volume_size=None,volume_type=None)] {{(pid=100593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Apr 20 18:42:54.017326 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2fe6ca38-b8b8-47ce-8082-ab2191fc4c2f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.218095 Apr 20 18:42:54.018102 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 569/1133] 10.222.0.25 () {60 vars in 1137 bytes} [Tue Apr 20 18:42:52 2021] POST /compute/v2.1/servers => generated 406 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 20 18:42:54.029511 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-461f61ce-fbae-417c-868c-ee2050f9a495 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:54.030188 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-461f61ce-fbae-417c-868c-ee2050f9a495 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: fdef06ea-282e-4514-a2be-5b39a060c298] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:54.036853 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4a22ac4b-fef3-46a5-9314-12ac5a5414d9] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 20 18:42:54.115840 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-461f61ce-fbae-417c-868c-ee2050f9a495 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:54.124576 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-461f61ce-fbae-417c-868c-ee2050f9a495 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298" status: 200 len: 1093 microversion: 2.1 time: 0.099839 Apr 20 18:42:54.125331 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 565/1134] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:54 2021] GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298 => generated 1093 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:55.142652 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e743ebd0-54be-426d-b04d-d593d2cabbad tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:55.143324 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e743ebd0-54be-426d-b04d-d593d2cabbad tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: fdef06ea-282e-4514-a2be-5b39a060c298] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:55.155004 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e743ebd0-54be-426d-b04d-d593d2cabbad tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:55.155516 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e743ebd0-54be-426d-b04d-d593d2cabbad tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:55.156357 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e743ebd0-54be-426d-b04d-d593d2cabbad tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:55.156850 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e743ebd0-54be-426d-b04d-d593d2cabbad tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:55.284989 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e743ebd0-54be-426d-b04d-d593d2cabbad tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:55.294998 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e743ebd0-54be-426d-b04d-d593d2cabbad tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298" status: 200 len: 1191 microversion: 2.1 time: 0.156353 Apr 20 18:42:55.295632 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 570/1135] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:55 2021] GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298 => generated 1191 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:56.314862 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-acb06b2d-b5f4-4f76-977d-a56a0552fefa tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:56.315521 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-acb06b2d-b5f4-4f76-977d-a56a0552fefa tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: fdef06ea-282e-4514-a2be-5b39a060c298] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:56.343064 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO oslo.messaging._drivers.impl_rabbit [-] [4a22ac4b-fef3-46a5-9314-12ac5a5414d9] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 45480. Apr 20 18:42:56.347637 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-acb06b2d-b5f4-4f76-977d-a56a0552fefa tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:56.348492 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-acb06b2d-b5f4-4f76-977d-a56a0552fefa tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:56.349870 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-acb06b2d-b5f4-4f76-977d-a56a0552fefa tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:56.350572 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-acb06b2d-b5f4-4f76-977d-a56a0552fefa tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:56.862463 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-acb06b2d-b5f4-4f76-977d-a56a0552fefa tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:56.872157 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-acb06b2d-b5f4-4f76-977d-a56a0552fefa tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298" status: 200 len: 1277 microversion: 2.1 time: 0.562264 Apr 20 18:42:56.872805 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 566/1136] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:56 2021] GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298 => generated 1277 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:42:57.891238 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ca491964-436e-4309-82c6-cc18a2827743 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:57.892567 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ca491964-436e-4309-82c6-cc18a2827743 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: fdef06ea-282e-4514-a2be-5b39a060c298] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:57.901226 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ca491964-436e-4309-82c6-cc18a2827743 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:57.902291 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ca491964-436e-4309-82c6-cc18a2827743 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:57.903573 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ca491964-436e-4309-82c6-cc18a2827743 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:57.904296 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ca491964-436e-4309-82c6-cc18a2827743 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:57.967392 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-1d3c432c-fbc6-451e-b28d-b277407ed317 req-52ff4097-138c-49f0-a43f-76653e49af36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdef06ea-282e-4514-a2be-5b39a060c298", "tag": "0e297d74-b7d9-43d2-a251-44ab7bf579f8"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:42:57.969161 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:42:57.969161 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:42:57.982869 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-1d3c432c-fbc6-451e-b28d-b277407ed317 req-52ff4097-138c-49f0-a43f-76653e49af36 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:57.983592 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-1d3c432c-fbc6-451e-b28d-b277407ed317 req-52ff4097-138c-49f0-a43f-76653e49af36 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:58.003419 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-1d3c432c-fbc6-451e-b28d-b277407ed317 req-52ff4097-138c-49f0-a43f-76653e49af36 service nova] Creating event network-changed:0e297d74-b7d9-43d2-a251-44ab7bf579f8 for instance fdef06ea-282e-4514-a2be-5b39a060c298 on hv-cinder-78693 Apr 20 18:42:58.008871 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-1d3c432c-fbc6-451e-b28d-b277407ed317 req-52ff4097-138c-49f0-a43f-76653e49af36 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200797 Apr 20 18:42:58.009575 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 571/1137] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:42:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:42:58.316439 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ca491964-436e-4309-82c6-cc18a2827743 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:58.325862 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ca491964-436e-4309-82c6-cc18a2827743 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298" status: 200 len: 1265 microversion: 2.1 time: 0.439398 Apr 20 18:42:58.326504 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 567/1138] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:57 2021] GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298 => generated 1265 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:42:59.345574 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c5c52f66-2b0e-46f0-9595-057ec5ce3e1d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:42:59.346274 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c5c52f66-2b0e-46f0-9595-057ec5ce3e1d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: fdef06ea-282e-4514-a2be-5b39a060c298] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:42:59.354701 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c5c52f66-2b0e-46f0-9595-057ec5ce3e1d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:59.355805 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c5c52f66-2b0e-46f0-9595-057ec5ce3e1d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:59.356654 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c5c52f66-2b0e-46f0-9595-057ec5ce3e1d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:42:59.357148 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c5c52f66-2b0e-46f0-9595-057ec5ce3e1d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:42:59.578638 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c5c52f66-2b0e-46f0-9595-057ec5ce3e1d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:42:59.587594 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c5c52f66-2b0e-46f0-9595-057ec5ce3e1d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298" status: 200 len: 1265 microversion: 2.1 time: 0.246785 Apr 20 18:42:59.588233 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 572/1139] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:42:59 2021] GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298 => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:43:00.606259 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-bee6631d-bda2-47d4-a132-7a1b6dc428a9 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:43:00.606936 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-bee6631d-bda2-47d4-a132-7a1b6dc428a9 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: fdef06ea-282e-4514-a2be-5b39a060c298] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:00.614907 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bee6631d-bda2-47d4-a132-7a1b6dc428a9 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:00.615420 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bee6631d-bda2-47d4-a132-7a1b6dc428a9 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:00.616261 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bee6631d-bda2-47d4-a132-7a1b6dc428a9 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:00.616759 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bee6631d-bda2-47d4-a132-7a1b6dc428a9 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:00.839545 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-bee6631d-bda2-47d4-a132-7a1b6dc428a9 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:43:00.848619 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-bee6631d-bda2-47d4-a132-7a1b6dc428a9 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298" status: 200 len: 1265 microversion: 2.1 time: 0.246709 Apr 20 18:43:00.849537 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 568/1140] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:43:00 2021] GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:43:01.867181 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4275f340-a33c-447b-975e-4c207cf2b6cf tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:43:01.867883 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4275f340-a33c-447b-975e-4c207cf2b6cf tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: fdef06ea-282e-4514-a2be-5b39a060c298] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:01.876379 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4275f340-a33c-447b-975e-4c207cf2b6cf tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:01.876881 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4275f340-a33c-447b-975e-4c207cf2b6cf tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:01.877739 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4275f340-a33c-447b-975e-4c207cf2b6cf tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:01.878227 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4275f340-a33c-447b-975e-4c207cf2b6cf tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:02.096324 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4275f340-a33c-447b-975e-4c207cf2b6cf tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:43:02.106155 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4275f340-a33c-447b-975e-4c207cf2b6cf tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298" status: 200 len: 1265 microversion: 2.1 time: 0.242873 Apr 20 18:43:02.106784 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 573/1141] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:43:01 2021] GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:43:03.123788 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-b102236c-61fb-41fb-9ba6-944846c7422e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:43:03.124466 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-b102236c-61fb-41fb-9ba6-944846c7422e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: fdef06ea-282e-4514-a2be-5b39a060c298] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:03.132385 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b102236c-61fb-41fb-9ba6-944846c7422e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:03.132894 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b102236c-61fb-41fb-9ba6-944846c7422e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:03.133763 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b102236c-61fb-41fb-9ba6-944846c7422e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:03.134258 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-b102236c-61fb-41fb-9ba6-944846c7422e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:03.353289 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-b102236c-61fb-41fb-9ba6-944846c7422e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:43:03.362921 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-b102236c-61fb-41fb-9ba6-944846c7422e tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298" status: 200 len: 1265 microversion: 2.1 time: 0.243327 Apr 20 18:43:03.363554 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 569/1142] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:43:03 2021] GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:43:04.380869 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e318460d-f940-4020-a056-8b9763224b33 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:43:04.381587 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e318460d-f940-4020-a056-8b9763224b33 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: fdef06ea-282e-4514-a2be-5b39a060c298] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:04.389826 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e318460d-f940-4020-a056-8b9763224b33 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:04.390345 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e318460d-f940-4020-a056-8b9763224b33 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:04.391194 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e318460d-f940-4020-a056-8b9763224b33 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:04.391693 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e318460d-f940-4020-a056-8b9763224b33 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:04.610889 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e318460d-f940-4020-a056-8b9763224b33 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:43:04.619772 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e318460d-f940-4020-a056-8b9763224b33 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298" status: 200 len: 1265 microversion: 2.1 time: 0.242952 Apr 20 18:43:04.620553 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 574/1143] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:43:04 2021] GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:43:05.638573 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-848d6589-1a0a-4322-a246-384e98d1a77a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:43:05.639298 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-848d6589-1a0a-4322-a246-384e98d1a77a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: fdef06ea-282e-4514-a2be-5b39a060c298] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:05.647309 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-848d6589-1a0a-4322-a246-384e98d1a77a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:05.647819 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-848d6589-1a0a-4322-a246-384e98d1a77a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:05.648658 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-848d6589-1a0a-4322-a246-384e98d1a77a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:05.649153 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-848d6589-1a0a-4322-a246-384e98d1a77a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:05.865806 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-848d6589-1a0a-4322-a246-384e98d1a77a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:43:05.875566 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-848d6589-1a0a-4322-a246-384e98d1a77a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298" status: 200 len: 1265 microversion: 2.1 time: 0.241774 Apr 20 18:43:05.876202 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 570/1144] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:43:05 2021] GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:43:06.893677 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-838ce2bc-d181-441e-834f-79c036cf377c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:43:06.894388 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-838ce2bc-d181-441e-834f-79c036cf377c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: fdef06ea-282e-4514-a2be-5b39a060c298] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:06.902874 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-838ce2bc-d181-441e-834f-79c036cf377c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:06.903373 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-838ce2bc-d181-441e-834f-79c036cf377c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:06.904208 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-838ce2bc-d181-441e-834f-79c036cf377c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:06.904702 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-838ce2bc-d181-441e-834f-79c036cf377c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:07.121710 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-838ce2bc-d181-441e-834f-79c036cf377c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:43:07.130660 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-838ce2bc-d181-441e-834f-79c036cf377c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298" status: 200 len: 1265 microversion: 2.1 time: 0.241167 Apr 20 18:43:07.131274 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 575/1145] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:43:06 2021] GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:43:08.037034 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-413b9491-bf7b-4472-bcb3-7c14b6331154 req-d9bd9338-b58d-42f8-970f-8b2eefbcbd04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdef06ea-282e-4514-a2be-5b39a060c298", "name": "network-vif-plugged", "status": "completed", "tag": "0e297d74-b7d9-43d2-a251-44ab7bf579f8"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:43:08.038897 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:43:08.038897 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:43:08.048489 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-413b9491-bf7b-4472-bcb3-7c14b6331154 req-d9bd9338-b58d-42f8-970f-8b2eefbcbd04 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:08.048996 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-413b9491-bf7b-4472-bcb3-7c14b6331154 req-d9bd9338-b58d-42f8-970f-8b2eefbcbd04 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:08.070358 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-413b9491-bf7b-4472-bcb3-7c14b6331154 req-d9bd9338-b58d-42f8-970f-8b2eefbcbd04 service nova] Creating event network-vif-plugged:0e297d74-b7d9-43d2-a251-44ab7bf579f8 for instance fdef06ea-282e-4514-a2be-5b39a060c298 on hv-cinder-78693 Apr 20 18:43:08.075750 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-413b9491-bf7b-4472-bcb3-7c14b6331154 req-d9bd9338-b58d-42f8-970f-8b2eefbcbd04 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105233 Apr 20 18:43:08.076469 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 571/1146] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:43:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:43:08.149085 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-fd789d79-082d-4fb3-b6e7-c7478e67beca tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:43:08.149780 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-fd789d79-082d-4fb3-b6e7-c7478e67beca tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: fdef06ea-282e-4514-a2be-5b39a060c298] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:08.157705 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fd789d79-082d-4fb3-b6e7-c7478e67beca tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:08.158208 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fd789d79-082d-4fb3-b6e7-c7478e67beca tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:08.159041 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fd789d79-082d-4fb3-b6e7-c7478e67beca tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:08.159554 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-fd789d79-082d-4fb3-b6e7-c7478e67beca tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:08.638279 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-fd789d79-082d-4fb3-b6e7-c7478e67beca tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:43:08.648397 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-fd789d79-082d-4fb3-b6e7-c7478e67beca tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298" status: 200 len: 1265 microversion: 2.1 time: 0.503926 Apr 20 18:43:08.649040 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 576/1147] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:43:08 2021] GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298 => generated 1265 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:43:09.670119 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e60e9397-7d55-47df-9105-24138beb1251 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:43:09.670938 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e60e9397-7d55-47df-9105-24138beb1251 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: fdef06ea-282e-4514-a2be-5b39a060c298] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:09.679293 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e60e9397-7d55-47df-9105-24138beb1251 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:09.679810 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e60e9397-7d55-47df-9105-24138beb1251 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:09.680662 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e60e9397-7d55-47df-9105-24138beb1251 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:09.681242 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e60e9397-7d55-47df-9105-24138beb1251 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:09.896670 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e60e9397-7d55-47df-9105-24138beb1251 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:43:09.906098 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e60e9397-7d55-47df-9105-24138beb1251 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298" status: 200 len: 1453 microversion: 2.1 time: 0.241520 Apr 20 18:43:09.906724 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 572/1148] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:43:09 2021] GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298 => generated 1453 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:43:09.923890 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-81953ead-4bc9-4ea4-a0e5-cc93d03ba71d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:43:09.924521 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-81953ead-4bc9-4ea4-a0e5-cc93d03ba71d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: fdef06ea-282e-4514-a2be-5b39a060c298] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:09.932430 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-81953ead-4bc9-4ea4-a0e5-cc93d03ba71d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:09.933005 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-81953ead-4bc9-4ea4-a0e5-cc93d03ba71d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:09.933894 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-81953ead-4bc9-4ea4-a0e5-cc93d03ba71d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:09.934384 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-81953ead-4bc9-4ea4-a0e5-cc93d03ba71d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:10.147566 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-81953ead-4bc9-4ea4-a0e5-cc93d03ba71d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:43:10.157220 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-81953ead-4bc9-4ea4-a0e5-cc93d03ba71d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298" status: 200 len: 1453 microversion: 2.1 time: 0.237366 Apr 20 18:43:10.157935 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 577/1149] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:43:09 2021] GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298 => generated 1453 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:43:12.835028 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-e4639a31-77a7-42d5-a5ac-c76c7d66ccd1 req-1bb37ea9-4a5c-434f-a0c5-e176570a0359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdef06ea-282e-4514-a2be-5b39a060c298", "tag": "0e297d74-b7d9-43d2-a251-44ab7bf579f8"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:43:12.836767 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:43:12.836767 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:43:12.846972 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-e4639a31-77a7-42d5-a5ac-c76c7d66ccd1 req-1bb37ea9-4a5c-434f-a0c5-e176570a0359 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:12.847473 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-e4639a31-77a7-42d5-a5ac-c76c7d66ccd1 req-1bb37ea9-4a5c-434f-a0c5-e176570a0359 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:12.866209 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-e4639a31-77a7-42d5-a5ac-c76c7d66ccd1 req-1bb37ea9-4a5c-434f-a0c5-e176570a0359 service nova] Creating event network-changed:0e297d74-b7d9-43d2-a251-44ab7bf579f8 for instance fdef06ea-282e-4514-a2be-5b39a060c298 on hv-cinder-78693 Apr 20 18:43:12.872247 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-e4639a31-77a7-42d5-a5ac-c76c7d66ccd1 req-1bb37ea9-4a5c-434f-a0c5-e176570a0359 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041069 Apr 20 18:43:12.872914 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 573/1150] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:43:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:43:31.418716 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:43:31.419138 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: Tue Apr 20 18:43:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:43:45.166720 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-97f62c58-8e36-48cb-afab-bd431d74e067 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:43:45.167303 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-97f62c58-8e36-48cb-afab-bd431d74e067 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:45.171089 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dd28f203-94b8-43ed-97a1-7e9255413705] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 20 18:43:45.176566 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-97f62c58-8e36-48cb-afab-bd431d74e067 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:45.177084 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-97f62c58-8e36-48cb-afab-bd431d74e067 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:45.177968 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-97f62c58-8e36-48cb-afab-bd431d74e067 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:45.178472 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-97f62c58-8e36-48cb-afab-bd431d74e067 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:45.240528 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-97f62c58-8e36-48cb-afab-bd431d74e067 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lazy-loading 'flavor' on Instance uuid 8feff501-cea0-4c8a-a991-593fc8e47fd9 {{(pid=100593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:43:45.537050 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-97f62c58-8e36-48cb-afab-bd431d74e067 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "POST /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9/action" status: 202 len: 0 microversion: 2.1 time: 0.374318 Apr 20 18:43:45.537787 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 578/1151] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:43:45 2021] POST /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:43:45.548342 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-3553d64a-3036-48c9-abef-8224c0492139 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:43:45.549131 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-3553d64a-3036-48c9-abef-8224c0492139 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:45.557643 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3553d64a-3036-48c9-abef-8224c0492139 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:45.558161 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3553d64a-3036-48c9-abef-8224c0492139 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:45.559633 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3553d64a-3036-48c9-abef-8224c0492139 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:45.560127 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-3553d64a-3036-48c9-abef-8224c0492139 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:45.788795 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-3553d64a-3036-48c9-abef-8224c0492139 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:43:45.798401 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-3553d64a-3036-48c9-abef-8224c0492139 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1568 microversion: 2.1 time: 0.255296 Apr 20 18:43:45.799042 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 574/1152] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:43:45 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1568 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:43:46.829482 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-53ed7f6a-ee32-4d61-b7d1-18cbc46f6bac tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:43:46.830267 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-53ed7f6a-ee32-4d61-b7d1-18cbc46f6bac tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:46.838382 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-53ed7f6a-ee32-4d61-b7d1-18cbc46f6bac tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:46.838890 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-53ed7f6a-ee32-4d61-b7d1-18cbc46f6bac tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:46.839768 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-53ed7f6a-ee32-4d61-b7d1-18cbc46f6bac tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:46.840263 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-53ed7f6a-ee32-4d61-b7d1-18cbc46f6bac tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:46.896312 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO oslo.messaging._drivers.impl_rabbit [-] [dd28f203-94b8-43ed-97a1-7e9255413705] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 45544. Apr 20 18:43:47.060991 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-53ed7f6a-ee32-4d61-b7d1-18cbc46f6bac tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:43:47.070253 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-53ed7f6a-ee32-4d61-b7d1-18cbc46f6bac tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1568 microversion: 2.1 time: 0.256525 Apr 20 18:43:47.070886 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 579/1153] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:43:46 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:43:48.089233 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-01883233-21a8-4ec2-9f2a-3c22e5cfebed tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:43:48.089940 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-01883233-21a8-4ec2-9f2a-3c22e5cfebed tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:48.098312 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-01883233-21a8-4ec2-9f2a-3c22e5cfebed tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:48.099093 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-01883233-21a8-4ec2-9f2a-3c22e5cfebed tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:48.099985 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-01883233-21a8-4ec2-9f2a-3c22e5cfebed tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:48.100506 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-01883233-21a8-4ec2-9f2a-3c22e5cfebed tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:48.318037 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-01883233-21a8-4ec2-9f2a-3c22e5cfebed tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:43:48.327833 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-01883233-21a8-4ec2-9f2a-3c22e5cfebed tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1568 microversion: 2.1 time: 0.242683 Apr 20 18:43:48.328506 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 575/1154] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:43:48 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1568 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:43:49.346167 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6a63db85-7fc3-4c86-b498-15a4854dca30 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:43:49.346841 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6a63db85-7fc3-4c86-b498-15a4854dca30 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:49.355080 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6a63db85-7fc3-4c86-b498-15a4854dca30 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:49.355585 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6a63db85-7fc3-4c86-b498-15a4854dca30 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:49.356423 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6a63db85-7fc3-4c86-b498-15a4854dca30 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:49.356919 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6a63db85-7fc3-4c86-b498-15a4854dca30 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:49.567823 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6a63db85-7fc3-4c86-b498-15a4854dca30 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:43:49.578030 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6a63db85-7fc3-4c86-b498-15a4854dca30 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1568 microversion: 2.1 time: 0.236525 Apr 20 18:43:49.578662 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 580/1155] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:43:49 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:43:50.597703 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-f06d9c46-9f94-41b6-8150-3dffe9dbab43 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:43:50.598450 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-f06d9c46-9f94-41b6-8150-3dffe9dbab43 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:50.606819 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f06d9c46-9f94-41b6-8150-3dffe9dbab43 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:50.607832 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f06d9c46-9f94-41b6-8150-3dffe9dbab43 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:50.608772 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f06d9c46-9f94-41b6-8150-3dffe9dbab43 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:50.609295 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-f06d9c46-9f94-41b6-8150-3dffe9dbab43 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:50.823144 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-f06d9c46-9f94-41b6-8150-3dffe9dbab43 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:43:50.832239 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-f06d9c46-9f94-41b6-8150-3dffe9dbab43 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1568 microversion: 2.1 time: 0.239848 Apr 20 18:43:50.832868 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 576/1156] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:43:50 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:43:51.850710 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-7e74bb37-b5f7-49d4-b36e-f075dcc2a84f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:43:51.851383 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-7e74bb37-b5f7-49d4-b36e-f075dcc2a84f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:51.859439 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7e74bb37-b5f7-49d4-b36e-f075dcc2a84f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:51.859945 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7e74bb37-b5f7-49d4-b36e-f075dcc2a84f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:51.860784 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7e74bb37-b5f7-49d4-b36e-f075dcc2a84f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:51.861276 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-7e74bb37-b5f7-49d4-b36e-f075dcc2a84f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:52.085444 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-7e74bb37-b5f7-49d4-b36e-f075dcc2a84f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:43:52.095022 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-7e74bb37-b5f7-49d4-b36e-f075dcc2a84f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1568 microversion: 2.1 time: 0.248641 Apr 20 18:43:52.095639 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 581/1157] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:43:51 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:43:53.113629 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-298a4318-340e-4881-8b55-74f8c12205d8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:43:53.114313 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-298a4318-340e-4881-8b55-74f8c12205d8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:53.122434 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-298a4318-340e-4881-8b55-74f8c12205d8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:53.122953 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-298a4318-340e-4881-8b55-74f8c12205d8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:53.123755 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-298a4318-340e-4881-8b55-74f8c12205d8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:53.124256 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-298a4318-340e-4881-8b55-74f8c12205d8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:53.340153 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-298a4318-340e-4881-8b55-74f8c12205d8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:43:53.349445 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-298a4318-340e-4881-8b55-74f8c12205d8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1568 microversion: 2.1 time: 0.240115 Apr 20 18:43:53.350085 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 577/1158] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:43:53 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:43:54.367228 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-30359ac6-3c52-42c2-bf7d-1ddf4d359cb8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:43:54.367956 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-30359ac6-3c52-42c2-bf7d-1ddf4d359cb8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:54.376158 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-30359ac6-3c52-42c2-bf7d-1ddf4d359cb8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:54.376677 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-30359ac6-3c52-42c2-bf7d-1ddf4d359cb8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:54.377553 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-30359ac6-3c52-42c2-bf7d-1ddf4d359cb8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:54.378178 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-30359ac6-3c52-42c2-bf7d-1ddf4d359cb8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:54.589776 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-30359ac6-3c52-42c2-bf7d-1ddf4d359cb8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:43:54.599603 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-30359ac6-3c52-42c2-bf7d-1ddf4d359cb8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1568 microversion: 2.1 time: 0.236422 Apr 20 18:43:54.600234 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 582/1159] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:43:54 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:43:55.618306 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-6b125cc3-d319-4513-aea7-0bab34e23a97 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:43:55.618983 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-6b125cc3-d319-4513-aea7-0bab34e23a97 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:55.627673 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6b125cc3-d319-4513-aea7-0bab34e23a97 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:55.628188 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6b125cc3-d319-4513-aea7-0bab34e23a97 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:55.629030 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6b125cc3-d319-4513-aea7-0bab34e23a97 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:55.629553 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-6b125cc3-d319-4513-aea7-0bab34e23a97 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:55.899750 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-6b125cc3-d319-4513-aea7-0bab34e23a97 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:43:55.909700 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-6b125cc3-d319-4513-aea7-0bab34e23a97 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1568 microversion: 2.1 time: 0.295536 Apr 20 18:43:55.910697 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 578/1160] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:43:55 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1568 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:43:56.928507 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ea1c0020-ac58-462b-9ae2-a55a5a8cc56f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:43:56.929174 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ea1c0020-ac58-462b-9ae2-a55a5a8cc56f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:56.937817 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ea1c0020-ac58-462b-9ae2-a55a5a8cc56f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:56.938334 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ea1c0020-ac58-462b-9ae2-a55a5a8cc56f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:56.939186 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ea1c0020-ac58-462b-9ae2-a55a5a8cc56f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:56.939682 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ea1c0020-ac58-462b-9ae2-a55a5a8cc56f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:57.163510 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-ea1c0020-ac58-462b-9ae2-a55a5a8cc56f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:43:57.172963 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ea1c0020-ac58-462b-9ae2-a55a5a8cc56f tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1568 microversion: 2.1 time: 0.248519 Apr 20 18:43:57.173606 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 583/1161] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:43:56 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:43:58.191881 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-29722a77-66d1-4a11-af2e-cabb5972b434 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:43:58.192562 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-29722a77-66d1-4a11-af2e-cabb5972b434 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:58.201224 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29722a77-66d1-4a11-af2e-cabb5972b434 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:58.201872 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29722a77-66d1-4a11-af2e-cabb5972b434 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:58.202739 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29722a77-66d1-4a11-af2e-cabb5972b434 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:58.203237 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-29722a77-66d1-4a11-af2e-cabb5972b434 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:58.427971 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-29722a77-66d1-4a11-af2e-cabb5972b434 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:43:58.438301 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-29722a77-66d1-4a11-af2e-cabb5972b434 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1568 microversion: 2.1 time: 0.250574 Apr 20 18:43:58.438969 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 579/1162] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:43:58 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:43:59.456704 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-691f47d1-775f-44a8-b436-ed8c76844e73 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:43:59.457410 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-691f47d1-775f-44a8-b436-ed8c76844e73 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:59.465829 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-691f47d1-775f-44a8-b436-ed8c76844e73 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:59.467186 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-691f47d1-775f-44a8-b436-ed8c76844e73 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:59.468238 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-691f47d1-775f-44a8-b436-ed8c76844e73 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:59.468741 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-691f47d1-775f-44a8-b436-ed8c76844e73 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:59.699157 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-691f47d1-775f-44a8-b436-ed8c76844e73 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:43:59.708741 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-691f47d1-775f-44a8-b436-ed8c76844e73 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1569 microversion: 2.1 time: 0.256289 Apr 20 18:43:59.709374 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 584/1163] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:43:59 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1569 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:43:59.727223 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-691e85a3-addc-4ea9-838f-12e043204b40 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:43:59.727903 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-691e85a3-addc-4ea9-838f-12e043204b40 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:59.735979 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-691e85a3-addc-4ea9-838f-12e043204b40 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:59.736491 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-691e85a3-addc-4ea9-838f-12e043204b40 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:59.737339 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-691e85a3-addc-4ea9-838f-12e043204b40 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:59.737862 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-691e85a3-addc-4ea9-838f-12e043204b40 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:59.906722 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-691e85a3-addc-4ea9-838f-12e043204b40 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "POST /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9/action" status: 202 len: 0 microversion: 2.1 time: 0.183772 Apr 20 18:43:59.907410 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 580/1164] 10.222.0.25 () {60 vars in 1268 bytes} [Tue Apr 20 18:43:59 2021] POST /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:43:59.921984 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-bbd622bb-d209-4c9b-b150-cc83df3e1ad3 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:43:59.923429 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-bbd622bb-d209-4c9b-b150-cc83df3e1ad3 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:43:59.938981 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bbd622bb-d209-4c9b-b150-cc83df3e1ad3 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:59.939569 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bbd622bb-d209-4c9b-b150-cc83df3e1ad3 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:43:59.940492 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bbd622bb-d209-4c9b-b150-cc83df3e1ad3 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:43:59.941046 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-bbd622bb-d209-4c9b-b150-cc83df3e1ad3 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:00.236625 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-bbd622bb-d209-4c9b-b150-cc83df3e1ad3 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:44:00.245908 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-bbd622bb-d209-4c9b-b150-cc83df3e1ad3 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1517 microversion: 2.1 time: 0.333172 Apr 20 18:44:00.246578 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 585/1165] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:43:59 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1517 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:44:01.265827 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-803b78a2-3ccc-41fd-b495-fd62ae0ea179 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:44:01.266555 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-803b78a2-3ccc-41fd-b495-fd62ae0ea179 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:44:01.274918 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-803b78a2-3ccc-41fd-b495-fd62ae0ea179 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:01.275456 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-803b78a2-3ccc-41fd-b495-fd62ae0ea179 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:01.276290 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-803b78a2-3ccc-41fd-b495-fd62ae0ea179 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:01.276784 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-803b78a2-3ccc-41fd-b495-fd62ae0ea179 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:01.513129 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-803b78a2-3ccc-41fd-b495-fd62ae0ea179 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:44:01.523388 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-803b78a2-3ccc-41fd-b495-fd62ae0ea179 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1519 microversion: 2.1 time: 0.261785 Apr 20 18:44:01.524059 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 581/1166] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:44:01 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1519 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:44:02.215559 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-b33dadb0-65de-4070-b580-11e924c8bf28 req-e8e716c5-4c64-48bb-872f-88017df544af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8feff501-cea0-4c8a-a991-593fc8e47fd9", "name": "network-vif-unplugged", "status": "completed", "tag": "518fd836-456c-4e9f-84fc-ed8258cb8385"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:02.218554 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:44:02.218554 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:44:02.229628 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-b33dadb0-65de-4070-b580-11e924c8bf28 req-e8e716c5-4c64-48bb-872f-88017df544af service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:02.230012 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-b33dadb0-65de-4070-b580-11e924c8bf28 req-e8e716c5-4c64-48bb-872f-88017df544af service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:02.249884 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.compute.server_external_events [req-b33dadb0-65de-4070-b580-11e924c8bf28 req-e8e716c5-4c64-48bb-872f-88017df544af service nova] Unable to find a host for instance 8feff501-cea0-4c8a-a991-593fc8e47fd9. Dropping event network-vif-unplugged {{(pid=100593) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Apr 20 18:44:02.250850 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-b33dadb0-65de-4070-b580-11e924c8bf28 req-e8e716c5-4c64-48bb-872f-88017df544af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039580 Apr 20 18:44:02.251682 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 586/1167] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:44:02 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 20 18:44:02.543301 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e58481a9-ef96-441d-8c04-bfd9b49d7039 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:44:02.543991 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e58481a9-ef96-441d-8c04-bfd9b49d7039 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:44:02.553683 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e58481a9-ef96-441d-8c04-bfd9b49d7039 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:02.554200 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e58481a9-ef96-441d-8c04-bfd9b49d7039 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:02.555111 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e58481a9-ef96-441d-8c04-bfd9b49d7039 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:02.555568 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e58481a9-ef96-441d-8c04-bfd9b49d7039 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:02.816208 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e58481a9-ef96-441d-8c04-bfd9b49d7039 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:44:02.826163 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e58481a9-ef96-441d-8c04-bfd9b49d7039 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1519 microversion: 2.1 time: 0.286815 Apr 20 18:44:02.826828 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 582/1168] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:44:02 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1519 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:44:03.845203 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-950b9b34-1d9c-416f-abf2-d09f6d892cbc tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:44:03.845918 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-950b9b34-1d9c-416f-abf2-d09f6d892cbc tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:44:03.854162 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-950b9b34-1d9c-416f-abf2-d09f6d892cbc tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:03.854667 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-950b9b34-1d9c-416f-abf2-d09f6d892cbc tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:03.855500 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-950b9b34-1d9c-416f-abf2-d09f6d892cbc tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:03.855990 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-950b9b34-1d9c-416f-abf2-d09f6d892cbc tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:04.074508 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-950b9b34-1d9c-416f-abf2-d09f6d892cbc tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:44:04.084042 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-950b9b34-1d9c-416f-abf2-d09f6d892cbc tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1575 microversion: 2.1 time: 0.243443 Apr 20 18:44:04.084674 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 587/1169] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:44:03 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1575 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:44:05.103171 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-d31a4c7e-e51e-4418-80e2-a6fcf0e2889d tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:44:05.103849 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-d31a4c7e-e51e-4418-80e2-a6fcf0e2889d tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:44:05.112264 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d31a4c7e-e51e-4418-80e2-a6fcf0e2889d tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:05.112777 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d31a4c7e-e51e-4418-80e2-a6fcf0e2889d tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:05.113649 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d31a4c7e-e51e-4418-80e2-a6fcf0e2889d tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:05.114147 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-d31a4c7e-e51e-4418-80e2-a6fcf0e2889d tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:05.329340 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-d31a4c7e-e51e-4418-80e2-a6fcf0e2889d tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:44:05.338457 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-d31a4c7e-e51e-4418-80e2-a6fcf0e2889d tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1575 microversion: 2.1 time: 0.239588 Apr 20 18:44:05.339104 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 583/1170] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:44:05 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1575 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:44:06.356877 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-18a31888-cf5f-4b8c-835b-713d67200d25 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:44:06.358034 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-18a31888-cf5f-4b8c-835b-713d67200d25 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:44:06.365900 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-18a31888-cf5f-4b8c-835b-713d67200d25 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:06.366403 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-18a31888-cf5f-4b8c-835b-713d67200d25 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:06.367235 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-18a31888-cf5f-4b8c-835b-713d67200d25 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:06.367719 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-18a31888-cf5f-4b8c-835b-713d67200d25 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:06.594542 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-18a31888-cf5f-4b8c-835b-713d67200d25 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:44:06.604070 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-18a31888-cf5f-4b8c-835b-713d67200d25 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1575 microversion: 2.1 time: 0.251252 Apr 20 18:44:06.604725 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 588/1171] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:44:06 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1575 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:44:07.622905 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-49343346-9c03-4d84-ad01-5308c82da1a5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:44:07.624102 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-49343346-9c03-4d84-ad01-5308c82da1a5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:44:07.632409 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-49343346-9c03-4d84-ad01-5308c82da1a5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:07.632924 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-49343346-9c03-4d84-ad01-5308c82da1a5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:07.633805 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-49343346-9c03-4d84-ad01-5308c82da1a5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:07.634302 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-49343346-9c03-4d84-ad01-5308c82da1a5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:07.877769 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-49343346-9c03-4d84-ad01-5308c82da1a5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:44:07.887013 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-49343346-9c03-4d84-ad01-5308c82da1a5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1575 microversion: 2.1 time: 0.268101 Apr 20 18:44:07.887668 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 584/1172] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:44:07 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1575 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:44:08.906667 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c6f62402-e78b-467c-8840-1a9e511739d3 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:44:08.907369 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c6f62402-e78b-467c-8840-1a9e511739d3 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:44:08.915459 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c6f62402-e78b-467c-8840-1a9e511739d3 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:08.915962 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c6f62402-e78b-467c-8840-1a9e511739d3 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:08.916791 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c6f62402-e78b-467c-8840-1a9e511739d3 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:08.917275 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c6f62402-e78b-467c-8840-1a9e511739d3 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:09.142386 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c6f62402-e78b-467c-8840-1a9e511739d3 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:44:09.152065 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c6f62402-e78b-467c-8840-1a9e511739d3 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1575 microversion: 2.1 time: 0.250123 Apr 20 18:44:09.152702 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 589/1173] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:44:08 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1575 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:44:10.170988 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9bc0a2e4-ad27-4656-b531-af91639ac4e2 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:44:10.171801 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9bc0a2e4-ad27-4656-b531-af91639ac4e2 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:44:10.180069 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9bc0a2e4-ad27-4656-b531-af91639ac4e2 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:10.180590 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9bc0a2e4-ad27-4656-b531-af91639ac4e2 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:10.181507 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9bc0a2e4-ad27-4656-b531-af91639ac4e2 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:10.182017 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9bc0a2e4-ad27-4656-b531-af91639ac4e2 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:10.438891 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9bc0a2e4-ad27-4656-b531-af91639ac4e2 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:44:10.449711 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9bc0a2e4-ad27-4656-b531-af91639ac4e2 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1575 microversion: 2.1 time: 0.282990 Apr 20 18:44:10.450523 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 585/1174] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:44:10 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1575 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:44:11.470016 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2ff1f84e-d74e-402b-abe0-f574f1cbdcc8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:44:11.470690 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2ff1f84e-d74e-402b-abe0-f574f1cbdcc8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:44:11.479269 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2ff1f84e-d74e-402b-abe0-f574f1cbdcc8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:11.479777 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2ff1f84e-d74e-402b-abe0-f574f1cbdcc8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:11.480620 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2ff1f84e-d74e-402b-abe0-f574f1cbdcc8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:11.481111 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2ff1f84e-d74e-402b-abe0-f574f1cbdcc8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:11.711603 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-2ff1f84e-d74e-402b-abe0-f574f1cbdcc8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:44:11.721316 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2ff1f84e-d74e-402b-abe0-f574f1cbdcc8 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1562 microversion: 2.1 time: 0.255995 Apr 20 18:44:11.721988 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 590/1175] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:44:11 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1562 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:44:12.382191 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-49bc8ea6-8ec3-4f1a-9d6a-925a6ce13256 req-51b954bb-7ac0-403b-b12f-6bf0a29ae8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8feff501-cea0-4c8a-a991-593fc8e47fd9", "name": "network-vif-plugged", "status": "completed", "tag": "518fd836-456c-4e9f-84fc-ed8258cb8385"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:12.384969 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:44:12.384969 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:44:12.395648 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-49bc8ea6-8ec3-4f1a-9d6a-925a6ce13256 req-51b954bb-7ac0-403b-b12f-6bf0a29ae8ec service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:12.396073 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-49bc8ea6-8ec3-4f1a-9d6a-925a6ce13256 req-51b954bb-7ac0-403b-b12f-6bf0a29ae8ec service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:12.414392 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-49bc8ea6-8ec3-4f1a-9d6a-925a6ce13256 req-51b954bb-7ac0-403b-b12f-6bf0a29ae8ec service nova] Creating event network-vif-plugged:518fd836-456c-4e9f-84fc-ed8258cb8385 for instance 8feff501-cea0-4c8a-a991-593fc8e47fd9 on hv-cinder-78693 Apr 20 18:44:12.420236 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-49bc8ea6-8ec3-4f1a-9d6a-925a6ce13256 req-51b954bb-7ac0-403b-b12f-6bf0a29ae8ec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043432 Apr 20 18:44:12.421123 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 586/1176] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:44:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:44:54.244218 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-60e3cd5c-ba87-4367-890f-a3045b3b1ab3 req-32f1fc7a-5f1b-41e8-9ee3-e43709d543f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdef06ea-282e-4514-a2be-5b39a060c298", "tag": "0e297d74-b7d9-43d2-a251-44ab7bf579f8"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:54.245963 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:44:54.245963 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:44:54.250834 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-eab4105e-44db-4d51-9f4a-acf807748952 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:44:54.251400 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-eab4105e-44db-4d51-9f4a-acf807748952 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: fdef06ea-282e-4514-a2be-5b39a060c298] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:44:54.259968 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eab4105e-44db-4d51-9f4a-acf807748952 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:54.260570 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eab4105e-44db-4d51-9f4a-acf807748952 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:54.261560 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eab4105e-44db-4d51-9f4a-acf807748952 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:54.262137 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-eab4105e-44db-4d51-9f4a-acf807748952 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:54.262245 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-60e3cd5c-ba87-4367-890f-a3045b3b1ab3 req-32f1fc7a-5f1b-41e8-9ee3-e43709d543f4 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:54.262639 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-60e3cd5c-ba87-4367-890f-a3045b3b1ab3 req-32f1fc7a-5f1b-41e8-9ee3-e43709d543f4 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:54.281952 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-60e3cd5c-ba87-4367-890f-a3045b3b1ab3 req-32f1fc7a-5f1b-41e8-9ee3-e43709d543f4 service nova] Creating event network-changed:0e297d74-b7d9-43d2-a251-44ab7bf579f8 for instance fdef06ea-282e-4514-a2be-5b39a060c298 on hv-cinder-78693 Apr 20 18:44:54.287415 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-60e3cd5c-ba87-4367-890f-a3045b3b1ab3 req-32f1fc7a-5f1b-41e8-9ee3-e43709d543f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047558 Apr 20 18:44:54.288129 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 587/1177] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:44:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:44:54.340125 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-eab4105e-44db-4d51-9f4a-acf807748952 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: fdef06ea-282e-4514-a2be-5b39a060c298] Going to try to terminate instance {{(pid=100593) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:44:54.477735 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-eab4105e-44db-4d51-9f4a-acf807748952 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298" status: 204 len: 0 microversion: 2.1 time: 0.241808 Apr 20 18:44:54.481424 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 591/1178] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:44:54 2021] DELETE /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:44:54.489846 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-80182bcb-a91c-46d7-8a5f-6574337010e0 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:44:54.490586 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-80182bcb-a91c-46d7-8a5f-6574337010e0 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: fdef06ea-282e-4514-a2be-5b39a060c298] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:44:54.499535 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-80182bcb-a91c-46d7-8a5f-6574337010e0 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:54.500103 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-80182bcb-a91c-46d7-8a5f-6574337010e0 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:54.500947 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-80182bcb-a91c-46d7-8a5f-6574337010e0 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:54.501457 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-80182bcb-a91c-46d7-8a5f-6574337010e0 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:54.936513 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-80182bcb-a91c-46d7-8a5f-6574337010e0 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:44:54.946900 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-80182bcb-a91c-46d7-8a5f-6574337010e0 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298" status: 200 len: 1578 microversion: 2.1 time: 0.461519 Apr 20 18:44:54.947747 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 588/1179] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:44:54 2021] GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298 => generated 1578 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:44:55.965999 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4e5b79be-e88e-4a1a-bea2-32bab14e1f7d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:44:55.966817 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-4e5b79be-e88e-4a1a-bea2-32bab14e1f7d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: fdef06ea-282e-4514-a2be-5b39a060c298] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:44:55.975246 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4e5b79be-e88e-4a1a-bea2-32bab14e1f7d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:55.975720 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4e5b79be-e88e-4a1a-bea2-32bab14e1f7d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:55.976522 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4e5b79be-e88e-4a1a-bea2-32bab14e1f7d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:55.977008 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-4e5b79be-e88e-4a1a-bea2-32bab14e1f7d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:56.197118 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-4e5b79be-e88e-4a1a-bea2-32bab14e1f7d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:44:56.206915 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4e5b79be-e88e-4a1a-bea2-32bab14e1f7d tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298" status: 200 len: 1459 microversion: 2.1 time: 0.245431 Apr 20 18:44:56.207558 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 592/1180] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:44:55 2021] GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298 => generated 1459 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:44:57.074872 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-14d414cc-ead1-4993-aa9d-cf7e063617b4 req-9094de5f-a042-42bd-afdf-916b7ea16d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdef06ea-282e-4514-a2be-5b39a060c298", "name": "network-vif-deleted", "tag": "0e297d74-b7d9-43d2-a251-44ab7bf579f8"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:57.077280 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:44:57.077280 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:44:57.086816 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-14d414cc-ead1-4993-aa9d-cf7e063617b4 req-9094de5f-a042-42bd-afdf-916b7ea16d54 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:57.087318 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-14d414cc-ead1-4993-aa9d-cf7e063617b4 req-9094de5f-a042-42bd-afdf-916b7ea16d54 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:57.107226 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-14d414cc-ead1-4993-aa9d-cf7e063617b4 req-9094de5f-a042-42bd-afdf-916b7ea16d54 service nova] Creating event network-vif-deleted:0e297d74-b7d9-43d2-a251-44ab7bf579f8 for instance fdef06ea-282e-4514-a2be-5b39a060c298 on hv-cinder-78693 Apr 20 18:44:57.112645 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-14d414cc-ead1-4993-aa9d-cf7e063617b4 req-9094de5f-a042-42bd-afdf-916b7ea16d54 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042393 Apr 20 18:44:57.113312 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 589/1181] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:44:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:44:57.225888 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9f848c49-1346-47c1-8a4e-eb696e677ae2 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:44:57.226665 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9f848c49-1346-47c1-8a4e-eb696e677ae2 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: fdef06ea-282e-4514-a2be-5b39a060c298] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:44:57.235403 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9f848c49-1346-47c1-8a4e-eb696e677ae2 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:57.235910 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9f848c49-1346-47c1-8a4e-eb696e677ae2 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:57.236751 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9f848c49-1346-47c1-8a4e-eb696e677ae2 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:57.237292 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9f848c49-1346-47c1-8a4e-eb696e677ae2 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:57.369292 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-9f848c49-1346-47c1-8a4e-eb696e677ae2 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:44:57.380395 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9f848c49-1346-47c1-8a4e-eb696e677ae2 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298" status: 200 len: 1224 microversion: 2.1 time: 0.158932 Apr 20 18:44:57.381229 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 593/1182] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:44:57 2021] GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298 => generated 1224 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:44:58.398914 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-427f3123-461f-43b9-97eb-1ce0f9f9f981 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:44:58.399800 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-427f3123-461f-43b9-97eb-1ce0f9f9f981 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: fdef06ea-282e-4514-a2be-5b39a060c298] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:44:58.408515 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-427f3123-461f-43b9-97eb-1ce0f9f9f981 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:58.409021 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-427f3123-461f-43b9-97eb-1ce0f9f9f981 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:58.409956 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-427f3123-461f-43b9-97eb-1ce0f9f9f981 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:44:58.410395 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-427f3123-461f-43b9-97eb-1ce0f9f9f981 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:44:58.463718 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-427f3123-461f-43b9-97eb-1ce0f9f9f981 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] HTTP exception thrown: Instance fdef06ea-282e-4514-a2be-5b39a060c298 could not be found. Apr 20 18:44:58.464393 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-427f3123-461f-43b9-97eb-1ce0f9f9f981 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Returning 404 to user: Instance fdef06ea-282e-4514-a2be-5b39a060c298 could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:44:58.465299 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-427f3123-461f-43b9-97eb-1ce0f9f9f981 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298" status: 404 len: 111 microversion: 2.1 time: 0.071202 Apr 20 18:44:58.465972 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 590/1183] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:44:58 2021] GET /compute/v2.1/servers/fdef06ea-282e-4514-a2be-5b39a060c298 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:45:02.411985 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-1976dc53-e590-497c-ba0d-d12603e6604a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:45:02.412700 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1976dc53-e590-497c-ba0d-d12603e6604a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:45:02.421236 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1976dc53-e590-497c-ba0d-d12603e6604a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:02.421913 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1976dc53-e590-497c-ba0d-d12603e6604a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:02.422679 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1976dc53-e590-497c-ba0d-d12603e6604a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:02.423182 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-1976dc53-e590-497c-ba0d-d12603e6604a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:02.487070 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-ad910a8e-8e5b-4c7e-8805-baffe10c4b94 req-64b81e4f-6687-46a8-821b-a089827bb2dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e", "tag": "3f62a456-a3af-4478-ac42-4fa222c97208"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:02.488953 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:45:02.488953 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:45:02.493656 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-1976dc53-e590-497c-ba0d-d12603e6604a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e] Going to try to terminate instance {{(pid=100593) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:45:02.498185 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-ad910a8e-8e5b-4c7e-8805-baffe10c4b94 req-64b81e4f-6687-46a8-821b-a089827bb2dd service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:02.499053 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-ad910a8e-8e5b-4c7e-8805-baffe10c4b94 req-64b81e4f-6687-46a8-821b-a089827bb2dd service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:02.517453 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-ad910a8e-8e5b-4c7e-8805-baffe10c4b94 req-64b81e4f-6687-46a8-821b-a089827bb2dd service nova] Creating event network-changed:3f62a456-a3af-4478-ac42-4fa222c97208 for instance 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e on hv-cinder-78693 Apr 20 18:45:02.522880 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-ad910a8e-8e5b-4c7e-8805-baffe10c4b94 req-64b81e4f-6687-46a8-821b-a089827bb2dd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110776 Apr 20 18:45:02.523918 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 591/1184] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:45:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:45:02.618275 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-1976dc53-e590-497c-ba0d-d12603e6604a tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e" status: 204 len: 0 microversion: 2.1 time: 0.209985 Apr 20 18:45:02.618922 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 594/1185] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:45:02 2021] DELETE /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:45:02.629888 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e9749b85-a8e7-443e-886f-8f0174bdb32c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:45:02.630758 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e9749b85-a8e7-443e-886f-8f0174bdb32c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:45:02.639819 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e9749b85-a8e7-443e-886f-8f0174bdb32c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:02.640329 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e9749b85-a8e7-443e-886f-8f0174bdb32c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:02.641184 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e9749b85-a8e7-443e-886f-8f0174bdb32c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:02.641710 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e9749b85-a8e7-443e-886f-8f0174bdb32c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:03.152231 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e9749b85-a8e7-443e-886f-8f0174bdb32c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:45:03.162558 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e9749b85-a8e7-443e-886f-8f0174bdb32c tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e" status: 200 len: 1580 microversion: 2.1 time: 0.537139 Apr 20 18:45:03.163434 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 592/1186] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:45:02 2021] GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e => generated 1580 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:45:04.182605 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-e2bb7271-3fb9-4871-821d-c85dea83cf7f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:45:04.183373 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-e2bb7271-3fb9-4871-821d-c85dea83cf7f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:45:04.191372 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e2bb7271-3fb9-4871-821d-c85dea83cf7f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:04.191880 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e2bb7271-3fb9-4871-821d-c85dea83cf7f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:04.192724 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e2bb7271-3fb9-4871-821d-c85dea83cf7f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:04.193218 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-e2bb7271-3fb9-4871-821d-c85dea83cf7f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:04.664673 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-e2bb7271-3fb9-4871-821d-c85dea83cf7f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:45:04.674495 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-e2bb7271-3fb9-4871-821d-c85dea83cf7f tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e" status: 200 len: 1461 microversion: 2.1 time: 0.496312 Apr 20 18:45:04.675073 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 595/1187] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:45:04 2021] GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e => generated 1461 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:45:05.189573 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-dcf2a880-c60d-497f-b83b-2acb07570558 req-ae8ea3ba-22ac-411d-82c5-35425a2adbef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e", "name": "network-vif-deleted", "tag": "3f62a456-a3af-4478-ac42-4fa222c97208"}]} {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:05.191470 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:45:05.191470 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:45:05.200855 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-dcf2a880-c60d-497f-b83b-2acb07570558 req-ae8ea3ba-22ac-411d-82c5-35425a2adbef service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:05.202838 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-dcf2a880-c60d-497f-b83b-2acb07570558 req-ae8ea3ba-22ac-411d-82c5-35425a2adbef service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:05.222078 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-dcf2a880-c60d-497f-b83b-2acb07570558 req-ae8ea3ba-22ac-411d-82c5-35425a2adbef service nova] Creating event network-vif-deleted:3f62a456-a3af-4478-ac42-4fa222c97208 for instance 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e on hv-cinder-78693 Apr 20 18:45:05.227956 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-dcf2a880-c60d-497f-b83b-2acb07570558 req-ae8ea3ba-22ac-411d-82c5-35425a2adbef service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043077 Apr 20 18:45:05.228626 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 593/1188] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:45:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:45:05.693252 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8bee3067-6a84-477b-ba3c-85a1b0afe0b4 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:45:05.694074 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8bee3067-6a84-477b-ba3c-85a1b0afe0b4 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:45:05.702864 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8bee3067-6a84-477b-ba3c-85a1b0afe0b4 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:05.703368 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8bee3067-6a84-477b-ba3c-85a1b0afe0b4 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:05.704202 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8bee3067-6a84-477b-ba3c-85a1b0afe0b4 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:05.704697 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8bee3067-6a84-477b-ba3c-85a1b0afe0b4 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:05.781197 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8bee3067-6a84-477b-ba3c-85a1b0afe0b4 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:05.781728 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8bee3067-6a84-477b-ba3c-85a1b0afe0b4 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:05.782231 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.objects.instance [None req-8bee3067-6a84-477b-ba3c-85a1b0afe0b4 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lazy-loading 'fault' on Instance uuid 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e {{(pid=100593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Apr 20 18:45:05.846434 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-8bee3067-6a84-477b-ba3c-85a1b0afe0b4 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a04013dbac84c5f93bdb7946e50d21d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38b0824b83f40c9874ffbc291951949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:45:05.855497 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8bee3067-6a84-477b-ba3c-85a1b0afe0b4 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e" status: 200 len: 1231 microversion: 2.1 time: 0.166424 Apr 20 18:45:05.856120 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 596/1189] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:45:05 2021] GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e => generated 1231 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:45:06.875083 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9e213ebf-6e91-434b-b10c-cf4f40e080a8 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:45:06.875859 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-9e213ebf-6e91-434b-b10c-cf4f40e080a8 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:45:06.884033 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9e213ebf-6e91-434b-b10c-cf4f40e080a8 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:06.884544 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9e213ebf-6e91-434b-b10c-cf4f40e080a8 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:06.885382 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9e213ebf-6e91-434b-b10c-cf4f40e080a8 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:06.885899 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-9e213ebf-6e91-434b-b10c-cf4f40e080a8 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:06.942210 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-9e213ebf-6e91-434b-b10c-cf4f40e080a8 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] HTTP exception thrown: Instance 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e could not be found. Apr 20 18:45:06.942886 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-9e213ebf-6e91-434b-b10c-cf4f40e080a8 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Returning 404 to user: Instance 4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:45:06.943795 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-9e213ebf-6e91-434b-b10c-cf4f40e080a8 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e" status: 404 len: 111 microversion: 2.1 time: 0.074095 Apr 20 18:45:06.944420 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 594/1190] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:45:06 2021] GET /compute/v2.1/servers/4b252fec-e4f0-4ea5-a5e4-e6fdf3212e4e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:45:07.762655 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2a7f00d3-9725-4062-98c9-541f481dd907 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:45:07.763215 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-2a7f00d3-9725-4062-98c9-541f481dd907 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:45:07.771320 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2a7f00d3-9725-4062-98c9-541f481dd907 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:07.771831 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2a7f00d3-9725-4062-98c9-541f481dd907 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:07.772667 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2a7f00d3-9725-4062-98c9-541f481dd907 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:07.773177 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-2a7f00d3-9725-4062-98c9-541f481dd907 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:07.826622 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-2a7f00d3-9725-4062-98c9-541f481dd907 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] HTTP exception thrown: Instance f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 could not be found. Apr 20 18:45:07.827291 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-2a7f00d3-9725-4062-98c9-541f481dd907 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Returning 404 to user: Instance f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 could not be found. {{(pid=100593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:45:07.828191 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-2a7f00d3-9725-4062-98c9-541f481dd907 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 404 len: 111 microversion: 2.1 time: 0.069636 Apr 20 18:45:07.828806 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 597/1191] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:45:07 2021] DELETE /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:45:07.837632 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8654f2f8-d8b5-4d8c-a3a2-409526037b55 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:45:07.838402 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-8654f2f8-d8b5-4d8c-a3a2-409526037b55 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] [instance: f4e41ddc-6fad-4179-8d1b-55e8bc4044c8] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:45:07.846823 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8654f2f8-d8b5-4d8c-a3a2-409526037b55 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:07.847325 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8654f2f8-d8b5-4d8c-a3a2-409526037b55 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:07.848465 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8654f2f8-d8b5-4d8c-a3a2-409526037b55 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:07.848996 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-8654f2f8-d8b5-4d8c-a3a2-409526037b55 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:07.900805 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-8654f2f8-d8b5-4d8c-a3a2-409526037b55 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] HTTP exception thrown: Instance f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 could not be found. Apr 20 18:45:07.901483 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-8654f2f8-d8b5-4d8c-a3a2-409526037b55 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Returning 404 to user: Instance f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 could not be found. {{(pid=100592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:45:07.902387 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-8654f2f8-d8b5-4d8c-a3a2-409526037b55 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8" status: 404 len: 111 microversion: 2.1 time: 0.068899 Apr 20 18:45:07.903006 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 595/1192] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:45:07 2021] GET /compute/v2.1/servers/f4e41ddc-6fad-4179-8d1b-55e8bc4044c8 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:45:09.374853 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-4f8e95c2-7495-4a9a-9834-f77feef81c66 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] Calling method '.version_select at 0x7f418cd4dc80>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:45:09.397193 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-4f8e95c2-7495-4a9a-9834-f77feef81c66 tempest-TestVolumeBootPattern-2015247380 tempest-TestVolumeBootPattern-2015247380-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1782040926" status: 202 len: 0 microversion: 2.1 time: 0.027603 Apr 20 18:45:09.397892 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 598/1193] 10.222.0.25 () {58 vars in 1253 bytes} [Tue Apr 20 18:45:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1782040926 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:45:26.589529 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-cb5ebdcc-609d-4110-9a07-e9243997a73c tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:45:26.590239 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-cb5ebdcc-609d-4110-9a07-e9243997a73c tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:45:26.592122 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-56c919d8-5fe1-4869-aefe-4f371ec853fe req-2551d91b-5734-43e3-a83b-7b061c07e355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8feff501-cea0-4c8a-a991-593fc8e47fd9", "tag": "518fd836-456c-4e9f-84fc-ed8258cb8385"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:26.594252 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:45:26.594252 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:45:26.599057 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cb5ebdcc-609d-4110-9a07-e9243997a73c tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:26.599569 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cb5ebdcc-609d-4110-9a07-e9243997a73c tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:26.600516 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cb5ebdcc-609d-4110-9a07-e9243997a73c tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:26.601009 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-cb5ebdcc-609d-4110-9a07-e9243997a73c tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:26.604677 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-56c919d8-5fe1-4869-aefe-4f371ec853fe req-2551d91b-5734-43e3-a83b-7b061c07e355 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:26.605422 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-56c919d8-5fe1-4869-aefe-4f371ec853fe req-2551d91b-5734-43e3-a83b-7b061c07e355 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:26.623219 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-56c919d8-5fe1-4869-aefe-4f371ec853fe req-2551d91b-5734-43e3-a83b-7b061c07e355 service nova] Creating event network-changed:518fd836-456c-4e9f-84fc-ed8258cb8385 for instance 8feff501-cea0-4c8a-a991-593fc8e47fd9 on hv-cinder-78693 Apr 20 18:45:26.629426 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-56c919d8-5fe1-4869-aefe-4f371ec853fe req-2551d91b-5734-43e3-a83b-7b061c07e355 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041329 Apr 20 18:45:26.630454 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 599/1194] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:45:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:45:26.670352 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-cb5ebdcc-609d-4110-9a07-e9243997a73c tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Going to try to terminate instance {{(pid=100592) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 20 18:45:26.798359 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-cb5ebdcc-609d-4110-9a07-e9243997a73c tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 204 len: 0 microversion: 2.1 time: 0.212853 Apr 20 18:45:26.799460 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 596/1195] 10.222.0.25 () {58 vars in 1229 bytes} [Tue Apr 20 18:45:26 2021] DELETE /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:45:26.809467 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-dc3cdd03-8d12-42f1-902b-2273f95b5a78 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:45:26.810256 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-dc3cdd03-8d12-42f1-902b-2273f95b5a78 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:45:26.819037 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dc3cdd03-8d12-42f1-902b-2273f95b5a78 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:26.819550 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dc3cdd03-8d12-42f1-902b-2273f95b5a78 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:26.820392 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dc3cdd03-8d12-42f1-902b-2273f95b5a78 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:26.820996 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-dc3cdd03-8d12-42f1-902b-2273f95b5a78 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:27.075266 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-dc3cdd03-8d12-42f1-902b-2273f95b5a78 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100593) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:45:27.085812 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-dc3cdd03-8d12-42f1-902b-2273f95b5a78 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1568 microversion: 2.1 time: 0.280820 Apr 20 18:45:27.086494 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 600/1196] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:45:26 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1568 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:45:28.107642 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-630d25cb-ec44-4b34-8a24-22ecea8ebaee tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:45:28.109076 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-630d25cb-ec44-4b34-8a24-22ecea8ebaee tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:45:28.117184 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-630d25cb-ec44-4b34-8a24-22ecea8ebaee tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:28.117747 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-630d25cb-ec44-4b34-8a24-22ecea8ebaee tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:28.118601 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-630d25cb-ec44-4b34-8a24-22ecea8ebaee tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:28.119094 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-630d25cb-ec44-4b34-8a24-22ecea8ebaee tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:28.348270 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-630d25cb-ec44-4b34-8a24-22ecea8ebaee tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:45:28.357302 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-630d25cb-ec44-4b34-8a24-22ecea8ebaee tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1450 microversion: 2.1 time: 0.254308 Apr 20 18:45:28.358974 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 597/1197] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:45:28 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1450 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:45:29.344438 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [req-5a740d54-34c1-4371-8669-06ed9807cce6 req-2a0d6613-ec27-4acb-b322-564f120d0ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8feff501-cea0-4c8a-a991-593fc8e47fd9", "name": "network-vif-deleted", "tag": "518fd836-456c-4e9f-84fc-ed8258cb8385"}]} {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:29.346422 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 20 18:45:29.346422 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: warnings.warn(msg) Apr 20 18:45:29.355703 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-5a740d54-34c1-4371-8669-06ed9807cce6 req-2a0d6613-ec27-4acb-b322-564f120d0ce1 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:29.356214 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [req-5a740d54-34c1-4371-8669-06ed9807cce6 req-2a0d6613-ec27-4acb-b322-564f120d0ce1 service nova] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:29.377731 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-c473dc9a-6ad4-4ce2-978c-3bf227674bf5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:45:29.378580 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-c473dc9a-6ad4-4ce2-978c-3bf227674bf5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100592) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:45:29.389574 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.compute.server_external_events [req-5a740d54-34c1-4371-8669-06ed9807cce6 req-2a0d6613-ec27-4acb-b322-564f120d0ce1 service nova] Creating event network-vif-deleted:518fd836-456c-4e9f-84fc-ed8258cb8385 for instance 8feff501-cea0-4c8a-a991-593fc8e47fd9 on hv-cinder-78693 Apr 20 18:45:29.391194 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c473dc9a-6ad4-4ce2-978c-3bf227674bf5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:29.392388 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c473dc9a-6ad4-4ce2-978c-3bf227674bf5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:29.393929 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c473dc9a-6ad4-4ce2-978c-3bf227674bf5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:29.394460 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-c473dc9a-6ad4-4ce2-978c-3bf227674bf5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100592) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:29.394988 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [req-5a740d54-34c1-4371-8669-06ed9807cce6 req-2a0d6613-ec27-4acb-b322-564f120d0ce1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054643 Apr 20 18:45:29.395661 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 601/1198] 10.222.0.25 () {64 vars in 1308 bytes} [Tue Apr 20 18:45:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:45:29.539302 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.policy [None req-c473dc9a-6ad4-4ce2-978c-3bf227674bf5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f077064affd42f6867f45645a8ad78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b983d94220b40aead19fa67590f0415', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100592) authorize /opt/stack/nova/nova/policy.py:202}} Apr 20 18:45:29.549148 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-c473dc9a-6ad4-4ce2-978c-3bf227674bf5 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 200 len: 1218 microversion: 2.1 time: 0.176543 Apr 20 18:45:29.549797 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 598/1199] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:45:29 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 1218 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:45:30.568619 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ae885eed-39fd-40c9-b08a-0934459ae8bd tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '>' {{(pid=100593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:45:30.569480 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.compute.api [None req-ae885eed-39fd-40c9-b08a-0934459ae8bd tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [instance: 8feff501-cea0-4c8a-a991-593fc8e47fd9] Fetching instance by UUID {{(pid=100593) get /opt/stack/nova/nova/compute/api.py:2816}} Apr 20 18:45:30.579391 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ae885eed-39fd-40c9-b08a-0934459ae8bd tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:30.579912 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ae885eed-39fd-40c9-b08a-0934459ae8bd tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:30.580775 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ae885eed-39fd-40c9-b08a-0934459ae8bd tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Apr 20 18:45:30.581273 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG oslo_concurrency.lockutils [None req-ae885eed-39fd-40c9-b08a-0934459ae8bd tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Lock "2d5aad75-0cd5-4608-84e6-b1adec1c0420" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100593) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Apr 20 18:45:30.635164 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.wsgi [None req-ae885eed-39fd-40c9-b08a-0934459ae8bd tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] HTTP exception thrown: Instance 8feff501-cea0-4c8a-a991-593fc8e47fd9 could not be found. Apr 20 18:45:30.635841 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-ae885eed-39fd-40c9-b08a-0934459ae8bd tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Returning 404 to user: Instance 8feff501-cea0-4c8a-a991-593fc8e47fd9 could not be found. {{(pid=100593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:928}} Apr 20 18:45:30.636758 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-ae885eed-39fd-40c9-b08a-0934459ae8bd tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9" status: 404 len: 111 microversion: 2.1 time: 0.072722 Apr 20 18:45:30.637408 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100593|app: 0|req: 602/1200] 10.222.0.25 () {58 vars in 1226 bytes} [Tue Apr 20 18:45:30 2021] GET /compute/v2.1/servers/8feff501-cea0-4c8a-a991-593fc8e47fd9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:45:30.850462 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: DEBUG nova.api.openstack.wsgi [None req-233d7adf-15dc-4f95-b04f-b8a9a00c9fd2 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] Calling method '.version_select at 0x7f418e154400>' {{(pid=100592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Apr 20 18:45:30.853979 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: ERROR oslo.messaging._drivers.impl_rabbit [None req-233d7adf-15dc-4f95-b04f-b8a9a00c9fd2 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [b8f6b4c5-cabf-428c-a156-1bf25a722b36] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 20 18:45:31.870575 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO oslo.messaging._drivers.impl_rabbit [None req-233d7adf-15dc-4f95-b04f-b8a9a00c9fd2 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] [b8f6b4c5-cabf-428c-a156-1bf25a722b36] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 45774. Apr 20 18:45:31.888772 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO nova.api.openstack.requestlog [None req-233d7adf-15dc-4f95-b04f-b8a9a00c9fd2 tempest-TestShelveInstance-580358216 tempest-TestShelveInstance-580358216-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-231858898" status: 202 len: 0 microversion: 2.1 time: 1.042666 Apr 20 18:45:31.890391 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: [pid: 100592|app: 0|req: 599/1201] 10.222.0.25 () {58 vars in 1241 bytes} [Tue Apr 20 18:45:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-231858898 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:48:13.743417 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:48:13.744060 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: Tue Apr 20 18:48:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:48:38.566491 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:48:38.567107 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: Tue Apr 20 18:48:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:49:54.888344 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:49:54.889117 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: Tue Apr 20 18:49:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:50:11.440853 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:50:11.441522 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: Tue Apr 20 18:50:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:50:36.900761 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:50:36.901255 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: Tue Apr 20 18:50:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 20 18:50:45.246943 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 18:50:45.247600 dv-cinder-786932-2-iscsi devstack@n-api.service[100590]: Tue Apr 20 18:50:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!